The tag has no usage guidance.

learn more… | top users | synonyms

-1
votes
1answer
53 views

Multiprocessing usage and limitations [closed]

I'm not able to find any definite answers in the Python Docs. I'm looking for the limitations in 3.5 on MultiProcessing and using a worker pool. Are worker pools functionally limited to the number ...
6
votes
1answer
85 views

Python: Control subprocess from calling thread

I am working on a database interface to a MongoDB using Python Eve as an API. The database stores several documents containing parameters and values needed for some calculations. I wrote a Python ...
3
votes
2answers
277 views

are multithreading, multiprocessing, multitasking implemented at instruction set or OS?

On a computer with a single cpu core, must a multithreading program be implemented based on an OS? Can it be implemented in the instruction set and run without an OS? Can multiple programs run in ...
3
votes
1answer
156 views

How to efficiently implement this background processing chain?

I am working on an audio software that uses The EchoNest web service to identify and retrieve metadata about audio songs and I would like to have some advice on implementing a background processing ...
1
vote
1answer
126 views

How to effectively split jobs into groups for multiprocessing when the job sizes are unknown

With K processor cores, how to optimally split N jobs into groups, with each group to be processed sequentially by one processor core, when the time to process each job is unknown ahead of time and ...
10
votes
3answers
2k views

Python Multiprocessing with Queue vs ZeroMQ IPC

I am busy writing a Python application using ZeroMQ and implementing a variation of the Majordomo pattern as described in the ZGuide. I have a broker as an intermediary between a set of workers and ...
3
votes
1answer
825 views

Multiprocess RPC Architecture Design

I am currently working on a project that has client applications communicating with a server process. The client applications could be local to the same machine as the server process, on the same ...
6
votes
5answers
5k views

Can multiple CPU's / cores access the same RAM simutaneously?

This is what I guess would happen: If two cores tried to access the same address in RAM, one would have to wait for the other to access the RAM. The second time that each core would try to access ...
2
votes
3answers
1k views

Opinions on logging in multiprocess applications

We have written an application that spawns at least 9 parallel processes. All processes generate a lot of logging information. Currently we are using Python’s QueueHandler to consolidate all logs ...
2
votes
1answer
90 views

How to handle multi-processing of libraries which already spawn sub-processes?

I am having some trouble coming up with a good solution to limit sub-processes in a script which uses a multi-processed library and the script itself is also multi-processed. Both, the library and ...