Skip to content

CI/CD - Add GitHub Action for build and test in CI #4

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Open
abuccts wants to merge 4 commits into
base: msccl/v2.10.3-1
Choose a base branch
from
Open

CI/CD - Add GitHub Action for build and test in CI #4

Changes from all commits
Commits
Show all changes
4 commits
Select commit Hold shift + click to select a range
c73f787
Add GitHub Action for build and test in CI
abuccts Sep 8, 2021
c1d51a5
Remove `--network` to avoid conflict
abuccts Sep 8, 2021
87f0c7f
Update
abuccts Sep 10, 2021
8d74ffd
Fix build path
abuccts Sep 10, 2021
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
41 changes: 41 additions & 0 deletions .github/workflows/nccl-tests.yml
View file
Open in desktop
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
name: CI

on:
pull_request:
branches:
- msccl/*

jobs:
nccl-tests:
name: Build and run nccl tests
runs-on: [self-hosted, linux, x64, gpu]
container:
image: nvcr.io/nvidia/pytorch:19.12-py3
options: --privileged --ipc=host --gpus=all
steps:
- name: Checkout msccl
uses: actions/checkout@v2
- name: Checkout nccl-tests
uses: actions/checkout@v2
with:
repository: nvidia/nccl-tests
Copy link
Contributor

@saeedmaleki saeedmaleki Sep 14, 2021

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

is it possible to also fork nccl-tests? for reasons I have to explain in a meeting.

path: ./nccl-tests
- name: Build and install msccl
run: |
make src.build -j
make install
- name: Build nccl-tests
run: |
make MPI=1 MPI_HOME=/usr/local/mpi NCCL_HOME=../../build -j -C ./nccl-tests
- name: Test local all reduce
run: |
mpirun \
-allow-run-as-root -H localhost:4 -np 4 -mca btl ^openib \
-x LD_LIBRARY_PATH=/usr/local/lib -x NCCL_DEBUG=VERSION \
./nccl-tests/build/all_reduce_perf -b 1K -e 256M -f 2 -g 1 -c 1 -w 20 -n 50
- name: Test local alltoall
run: |
mpirun \
-allow-run-as-root -H localhost:4 -np 4 -mca btl ^openib \
-x LD_LIBRARY_PATH=/usr/local/lib -x NCCL_DEBUG=VERSION \
./nccl-tests/build/alltoall_perf -b 1K -e 256M -f 2 -g 1 -c 1 -w 20 -n 50