The error message ECOM00110 translates to “Cannot allocate temp picture, check pix fmt.”
You'll receive this error if you've specified a frame size that is not acceptable to the format you have chosen. This will happen when the frame size that is requested is too large for the selected codec.