On Sat, Feb 11, 2017 at 1:58 AM <mukund.8kmi...@gmail.com> wrote: > Are there any other methodologies where I can optimize compresssion part > and upload part > > Start by establishing a baseline. If you just grab the files from S3 and do nothing to to them, how fast is that? If you are not CPU-bound, chances are that you are just saturating something else, the IO-layer of the kernel for instance, and then no amount of tweaking inside Go is going to help you.
In short, Go (pun intended) for establishing your assumptions first, before jumping to optimization. One AWS-wisdom is that the most expensive thing they have is disk IO and usually you run your head against the IO being the bottleneck. You have to establish that their own tools (for instance) is beating you by more than a factor of 2 in the download/upload operation. If they are, you need to start profiling in order to figure out what they do differently than you. Once you know the bottleneck, optimize it. -- You received this message because you are subscribed to the Google Groups "golang-nuts" group. To unsubscribe from this group and stop receiving emails from it, send an email to golang-nuts+unsubscr...@googlegroups.com. For more options, visit https://groups.google.com/d/optout.
