Should I feel guilty for not holding my 2 month yr old?

My son will be 2 months tomorrow and he always wants to be held and rocked. I cant sit him down for more then 5 minutes without him screaming unless hes sleeping. Very rarely I will get him to sit contently in his bouncy chair so I can get some things done. Should I feel guilty for letting him just sit there while I do things? I feel guilty but then again Id probably feel guilty if I held him all day and sat him down for 2 mintues. What is your experiance with this? :(