3
votes
2answers
361 views

What is the most optimal algorithm for counting lines of text in a file?

File > 5Gb, simply with lines like apache access.log. Need to get number of lines. Any constructions like file(filename).read().counter('\n') Would read all of files and it would be very long ...
1
vote
0answers
232 views

Watching file changes/additions/removal, but with an eye on partial transfer

I would like to monitor the filesystem in python, so that my application gets warned of the new file addition, file removal, or file change. Once the file is detected, the application starts ...
0
votes
2answers
215 views

Ideal “intermediate” file format to use for structured/styled text?

I have files that I want to make available in an variety of formats: HTML PDF EPUB Plain Text (maybe) Most of the files will be sourced in doc, docx, or rtf format, so that needs to be considered. ...