Groups 60 of 99+ julia-users › parallel threads broken, replacing module 6 posts by 3 authors lapeyre....@gmail.com 7/29/15 Parallel threads has stopped working for me. Any ideas ? Code using addprocs and @everywhere include has stopped working (is broken) on one machine. Code that used to work now causes a number of varying errors to be printed, crashes, runaway processes, etc. when it is loaded. Both a recent v0.4 and a 2 month old version that did run the code in the past cause the failure. The same code on a different machine continues to run normally. Maybe my user Julia environment has a problem ? Or maybe I upgraded a system library ? If I use just 2 processes, the code will sometimes both load and run correctly. A minimal example test.jl ------ using Distributions ------ >julia -p 4 > @everywhere include("test.jl") WARNING: replacing module Distributions ( 4 times ) signal (11): Segmentation fault unknown function (ip: 0x7f235c7ffd98) jl_module_import at /usr/local/julia-0.4a/bin/../lib/julia/libjulia.so (unknown line) etc. I am running unstable debian linux. Thanks, John lapeyre....@gmail.com 7/29/15 Other recipients: lapeyre....@gmail.com I can file a bug report. But, I'm not entirely sure what to write. Simpler case: > julia -p 4 > @everywhere using ZChop (simple modules) The following version is from a completely fresh build today. I don't get a crash immediately, but I do get WARNING: replacing module ZChop (4 times) Version 0.4.0-dev+6394 (2015-07-29 21:58 UTC) Commit a2a218b* (0 days old master) Five days ago, i did git pull and built from an older clone Version 0.4.0-dev+6202 (2015-07-24 01:47 UTC) Commit 53a7f2e* (5 days old master) This version prints the same warning and spews many errors including unknown function (ip: 0x7fe94d596ff7) ERROR (unhandled task failure): EOFError: read end of file The following version will load ZChop with no problem, but when loading Distributions, it still prints many errors and fails. It loads some other modules (i.e with @everywhere, as above), such as Roots with no apparent errors. Version 0.4.0-dev+3965 (2015-03-22 12:24 UTC) Commit e1f0310* (129 days old master) A fresh build today on another machine gives errors with @everywhere using Roots. It fails to load Distributions even with no parallel threads, but this appears to be unrelated. On the same (other) machine, the following version loads and runs parallel code using the modules mentioned above, and more. Version 0.4.0-dev+4096 (2015-03-31 08:05 UTC) Commit a3c0743* (120 days old master) I see no error with 0.3.5-pre+121 (2015-01-07 00:19 UTC) - show quoted text - Seth 7/29/15 Other recipients: lapeyre....@gmail.com For what it's worth, I'm seeing the same thing: julia> @everywhere using LightGraphs WARNING: replacing module LightGraphs WARNING: replacing module LightGraphs WARNING: replacing module LightGraphs WARNING: replacing module LightGraphs exception on 4: ... (Lots of error messages / backtraces removed) ... ERROR: ProcessExitedException() in wait at /usr/local/julia-latest/lib/julia/sys.dylib in sync_end at /usr/local/julia-latest/lib/julia/sys.dylib in anonymous at multi.jl:348 - show quoted text - Seth 7/29/15 Other recipients: lapeyre....@gmail.com, catc...@bromberger.com Reference: https://github.com/JuliaLang/julia/issues/12381 - show quoted text - lapeyre....@gmail.com 7/30/15 Other recipients: catc...@bromberger.com Thanks Seth. - show quoted text - Nils Gudat 8/25/15 Other recipients: catc...@bromberger.com Can I just briefly revive this thread, as I don't want to spam the issue on GitHub? I just switched over from 0.3.11, and I'm having some issues with the parallel parts of my code. I have a couple of functions written in .jl files which I include at the beginning of my code, with each of these files containing the relevant using statements to load the modules they are depending on. In 0.3.11, I simply did: @everywhere begin include("functions1.jl") include("functions2.jl") ... end to define all the functions needed in the computation on all workers. Doing this now however results in one "WARNING: replacing module X" for each using statement, plus, in the case of PyCall, in a bunch of other warnings methods that couldn't be imported, modules that should have been imported, and method defintions that are being overwritten. What is the correct way to define functions and import modules on all workers in 0.4?