Skip to content

Commit db6ce68

Browse files
authored
BREAKING: Remove the ElasticManager functionality from this package (and point users to the external ElasticClusterManager.jl package instead) (#257)
1 parent a701c48 commit db6ce68

File tree

6 files changed

+2
-215
lines changed

6 files changed

+2
-215
lines changed

Project.toml

+1-1
Original file line numberDiff line numberDiff line change
@@ -1,6 +1,6 @@
11
name = "ClusterManagers"
22
uuid = "34f1f09b-3a8b-5176-ab39-66d58a4d544e"
3-
version = "1.1.0"
3+
version = "2.0.0"
44

55
[deps]
66
Distributed = "8ba89e20-285c-5b6f-9357-94700520ee1b"

README.md

+1-28
Original file line numberDiff line numberDiff line change
@@ -72,34 +72,7 @@ spread across CPU sockets. Default is `BALANCED`.
7272

7373
### Using `ElasticManager` (dynamically adding workers to a cluster)
7474

75-
The `ElasticManager` is useful in scenarios where we want to dynamically add workers to a cluster.
76-
It achieves this by listening on a known port on the master. The launched workers connect to this
77-
port and publish their own host/port information for other workers to connect to.
78-
79-
On the master, you need to instantiate an instance of `ElasticManager`. The constructors defined are:
80-
81-
```julia
82-
ElasticManager(;addr=IPv4("127.0.0.1"), port=9009, cookie=nothing, topology=:all_to_all, printing_kwargs=())
83-
ElasticManager(port) = ElasticManager(;port=port)
84-
ElasticManager(addr, port) = ElasticManager(;addr=addr, port=port)
85-
ElasticManager(addr, port, cookie) = ElasticManager(;addr=addr, port=port, cookie=cookie)
86-
```
87-
88-
You can set `addr=:auto` to automatically use the host's private IP address on the local network, which will allow other workers on this network to connect. You can also use `port=0` to let the OS choose a random free port for you (some systems may not support this). Once created, printing the `ElasticManager` object prints the command which you can run on workers to connect them to the master, e.g.:
89-
90-
```julia
91-
julia> em = ElasticManager(addr=:auto, port=0)
92-
ElasticManager:
93-
Active workers : []
94-
Number of workers to be added : 0
95-
Terminated workers : []
96-
Worker connect command :
97-
/home/user/bin/julia --project=/home/user/myproject/Project.toml -e 'using ClusterManagers; ClusterManagers.elastic_worker("4cOSyaYpgSl6BC0C","127.0.1.1",36275)'
98-
```
99-
100-
By default, the printed command uses the absolute path to the current Julia executable and activates the same project as the current session. You can change either of these defaults by passing `printing_kwargs=(absolute_exename=false, same_project=false))` to the first form of the `ElasticManager` constructor.
101-
102-
Once workers are connected, you can print the `em` object again to see them added to the list of active workers.
75+
For `ElasticManager`, please see the [ElasticClusterManager.jl](https://github.com/JuliaParallel/ElasticClusterManager.jl) package.
10376

10477
### Sun Grid Engine (SGE)
10578

src/ClusterManagers.jl

-1
Original file line numberDiff line numberDiff line change
@@ -18,6 +18,5 @@ include("scyld.jl")
1818
include("condor.jl")
1919
include("slurm.jl")
2020
include("affinity.jl")
21-
include("elastic.jl")
2221

2322
end

src/elastic.jl

-156
This file was deleted.

test/elastic.jl

-25
This file was deleted.

test/runtests.jl

-4
Original file line numberDiff line numberDiff line change
@@ -9,8 +9,6 @@ using Distributed: workers, nworkers
99
using Distributed: procs, nprocs
1010
using Distributed: remotecall_fetch, @spawnat
1111
using Test: @testset, @test, @test_skip
12-
# ElasticManager:
13-
using ClusterManagers: ElasticManager
1412
# Slurm:
1513
using ClusterManagers: addprocs_slurm, SlurmManager
1614
# SGE:
@@ -24,8 +22,6 @@ slurm_is_installed() = !isnothing(Sys.which("sbatch"))
2422
qsub_is_installed() = !isnothing(Sys.which("qsub"))
2523

2624
@testset "ClusterManagers.jl" begin
27-
include("elastic.jl")
28-
2925
if slurm_is_installed()
3026
@info "Running the Slurm tests..." Sys.which("sbatch")
3127
include("slurm.jl")

0 commit comments

Comments
 (0)