This video makes use of a distinct recording type from my others. Reasonably than recording repeatedly whereas I work, I pause recording when my code adjustments are taking a very long time to execute or I’ve some repetitive enhancing duties. The pausing of the recording successfully edits my video right down to a shorter period.
This lets me present you actual tasks and issues that usually take many hours to resolve, ones that contain numerous troubleshooting, investigating, debugging, trial and error, and considering.
I used to be engaged on this specific instance for many of a day however the ensuing video is simply 90 min which, sure, remains to be too lengthy. Be at liberty to play at a better pace and skip round. Subsequent time I’ll attempt to be extra aggressive in my pausing.
So, attending to the issue itself, I’ve some code that processes tons of of huge CSV recordsdata, which describe a graph of the connections between our web site pages every day. It takes a number of minutes to load and analyze every file, and the entire operating time is a number of hours. So I need to take a look at making an attempt to hurry it up.
I plan to work on these features:
- Use the profiler to search for locations I can pace up my serial code.
- Use parfor on my native machine with 6 bodily/12 logical processors
- Be sure my filenames work on Home windows and Linux
- Get it engaged on a 128 processors community Linux cluster
Options coated on this code-along type video embody:
Play the video in full display mode for a greater viewing expertise.
