Conversation
```shell $ dstack offer -b aws --gpu RTXPRO4500 # BACKEND RESOURCES INSTANCE TYPE PRICE 1 aws (us-east-2) cpu=8 mem=32GB disk=100GB gpu=RTXPRO4500:32GB:1 (spot) g7.2xlarge $0.3963 2 aws (us-east-2) cpu=32 mem=128GB disk=100GB gpu=RTXPRO4500:32GB:1 (spot) g7.8xlarge $0.4086 3 aws (us-east-2) cpu=16 mem=64GB disk=100GB gpu=RTXPRO4500:32GB:1 (spot) g7.4xlarge $0.4965 4 aws (us-east-2) cpu=48 mem=192GB disk=100GB gpu=RTXPRO4500:32GB:2 (spot) g7.12xlarge $0.7128 5 aws (us-west-2) cpu=32 mem=128GB disk=100GB gpu=RTXPRO4500:32GB:1 (spot) g7.8xlarge $0.7175 6 aws (us-west-2) cpu=8 mem=32GB disk=100GB gpu=RTXPRO4500:32GB:1 (spot) g7.2xlarge $0.7714 7 aws (us-west-2) cpu=16 mem=64GB disk=100GB gpu=RTXPRO4500:32GB:1 (spot) g7.4xlarge $0.8123 8 aws (us-east-2) cpu=96 mem=384GB disk=100GB gpu=RTXPRO4500:32GB:4 (spot) g7.24xlarge $1.4257 9 aws (us-west-2) cpu=96 mem=384GB disk=100GB gpu=RTXPRO4500:32GB:4 (spot) g7.24xlarge $1.5735 10 aws (us-west-2) cpu=48 mem=192GB disk=100GB gpu=RTXPRO4500:32GB:2 (spot) g7.12xlarge $2.0402 11 aws (us-east-1) cpu=8 mem=32GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.2xlarge $2.52 12 aws (us-west-2) cpu=8 mem=32GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.2xlarge $2.52 13 aws (us-east-2) cpu=8 mem=32GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.2xlarge $2.52 14 aws (us-east-2) cpu=192 mem=768GB disk=100GB gpu=RTXPRO4500:32GB:8 (spot) g7.48xlarge $2.8513 15 aws (us-east-2) cpu=16 mem=64GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.4xlarge $3.0421 16 aws (us-east-1) cpu=16 mem=64GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.4xlarge $3.0421 17 aws (us-west-2) cpu=16 mem=64GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.4xlarge $3.0421 18 aws (us-east-1) cpu=32 mem=128GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.8xlarge $4.0862 19 aws (us-west-2) cpu=32 mem=128GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.8xlarge $4.0862 20 aws (us-east-2) cpu=32 mem=128GB disk=100GB gpu=RTXPRO4500:32GB:1 g7.8xlarge $4.0862 21 aws (us-west-2) cpu=192 mem=768GB disk=100GB gpu=RTXPRO4500:32GB:8 (spot) g7.48xlarge $4.4543 22 aws (us-west-2) cpu=48 mem=192GB disk=100GB gpu=RTXPRO4500:32GB:2 g7.12xlarge $7.1283 23 aws (us-east-1) cpu=48 mem=192GB disk=100GB gpu=RTXPRO4500:32GB:2 g7.12xlarge $7.1283 24 aws (us-east-2) cpu=48 mem=192GB disk=100GB gpu=RTXPRO4500:32GB:2 g7.12xlarge $7.1283 25 aws (us-east-1) cpu=96 mem=384GB disk=100GB gpu=RTXPRO4500:32GB:4 g7.24xlarge $14.2566 26 aws (us-west-2) cpu=96 mem=384GB disk=100GB gpu=RTXPRO4500:32GB:4 g7.24xlarge $14.2566 27 aws (us-east-2) cpu=96 mem=384GB disk=100GB gpu=RTXPRO4500:32GB:4 g7.24xlarge $14.2566 28 aws (us-east-1) cpu=192 mem=768GB disk=100GB gpu=RTXPRO4500:32GB:8 g7.48xlarge $28.5133 29 aws (us-east-2) cpu=192 mem=768GB disk=100GB gpu=RTXPRO4500:32GB:8 g7.48xlarge $28.5133 30 aws (us-west-2) cpu=192 mem=768GB disk=100GB gpu=RTXPRO4500:32GB:8 g7.48xlarge $28.5133 ``` EFA is set up automatically on supported instance types (`g7.8xlarge`, `g7.12xlarge`, `g7.24xlarge`, `g7.48xlarge`).
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
EFA is set up automatically on supported instance types (
g7.8xlarge,g7.12xlarge,g7.24xlarge,g7.48xlarge). NCCL tests on 2xg7.48xlarge: nccl-tests.txtRelated: dstackai/gpuhunt#244