3 seconds are fine. Your bounce rate, in this case, is probably not being caused by lag/server issues. It's your content/landing page.
Also, you can try this using Google developer tool (F12). Just uncheck "Disable Cache In Developer Mode" and refresh the page with Network Tab on. You'll see...