Skip to content

Starting up a remote cluster #22

@kreczko

Description

@kreczko

Our current issue is that workers need to be able to connect to scheduler AND vice versa.

A workaround would be to use a Dask gateway at Bristol and start scheduler on the site.

Implementation:

  1. Start gateway on distributed.phy
  2. Start job on site X that starts the scheduler
  3. Once the scheduler connects to the gateway, submit worker jobs
  4. Everything else stays the same

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions