ARK v0.1.0
Features
- Scheduler
- The default scheduler
- Communication
- A simple software communication stack
- Operators
- Tensor
- Reshape
- Identity
- Sharding
- ReduceSum
- ReduceMean
- ReduceMax
- Layernorm
- Softmax
- Transpose
- Matmul
- Im2col
- Scale
- Relu
- Gelu
- Add
- Mul
- Send
- SendDone
- Recv
- SendMM
- RecvMM
- AllReduce
- AllGather
- Examples
- Tutorials
- A simple FFN training
- Transformer inference
- Megatron inference
New Contributors
Full Changelog: https://github.com/microsoft/ark/commits/v0.1.0