It seems the pipeline parallel document is out of date(https://www.colossalai.org/docs/features/pipeline_parallel)

[lambda7xx]

📚 The doc issue

It seems the pipeline parallel document is out of date(https://www.colossalai.org/docs/features/pipeline_parallel). When I try to use from colossalai.builder import build_pipeline_model, it seems it's none

[feifeibear]

@Gy-Lu @ver217 @binmakeswell can you update the PP doc?

[lambda7xx]

@Gy-Lu @ver217 @binmakeswell can you update the PP doc?

could you add the sequence parallelism doc? thank you very much.

[binmakeswell]

Hi @lambda7xx Thank you for your feedback. We will try to reproduce your issue and fix it soon.

[binmakeswell]

@Gy-Lu @ver217 @binmakeswell can you update the PP doc?

could you add the sequence parallelism doc? thank you very much.

Hi @lambda7xx For sequence parallel, you can check it here
https://github.com/hpcaitech/ColossalAI/tree/main/examples/tutorial/sequence_parallel

[Wesley-Jzy]

@lambda7xx Hi, we are now re-developing Pipeline Parallel so the doc is not ready to be updated. Here is an example for new Pipeline Parallel interface, FYI. We will update the doc as soon as possible. Thank you for your feedback. If you have any questions about the example, pls at me.

[Wesley-Jzy]

https://github.com/hpcaitech/ColossalAI-Examples/tree/main/features/pipeline_parallel

[lambda7xx]

@Gy-Lu @ver217 @binmakeswell can you update the PP doc?

could you add the sequence parallelism doc? thank you very much.

Hi @lambda7xx For sequence parallel, you can check it here https://github.com/hpcaitech/ColossalAI/tree/main/examples/tutorial/sequence_parallel

I have an issue about the link(https://github.com/hpcaitech/ColossalAI/tree/main/examples/tutorial/sequence_parallel).

#195 (comment))

I think there may be some bug of the example