Shawn Weisfeld

I find when I talk to myself nobody listens. - Shawn Weisfeld
posts - 365, comments - 174, trackbacks - 34

My Links

News


Shawn Weisfeld's Facebook profile

The views expressed in this blog are mine and mine alone, not that of my employer, Microsoft, or anyone else’s. No warrantee is given for the quality of any material on this site.

Archives

Post Categories

March 2013 Entries

Upload files to Azure Blobs FAST

CAUTION: This worked for me...Use it at your own risk. I was given a task to upload billions of small (10k) files to Azure, yes that is billions with a B. Like everyone else I started by reading the MSDN docs and having it show me the toBlob.UploadFile and toBlob.UploadFromStream. Both proved to be a bit slow in my case. I can only assume the issue is the overhead of opening and closing the connections. My first iteration was to just wrap everything with a Parallel.ForEach, and while this drastically improved things it still was not good enough. My second iteration...

posted @ Monday, March 11, 2013 9:18 AM | Feedback (0) |

Powered by: