A great place to start when trying to improve your video quality is to change the field 'Two pass' from no to yes. This applies to folks that are using the Desktop Application or web UI, for watchfolders or single add media requests. If you're an API user, toggle the <two_pass> field from no to yes. This should beef up the quality. Encodes will take a bit longer, but you'll be impressed with the quality improvement.
Find your answers here.