Will you make the pre-training code and training dataset public?

[handsomelys]

I admire and am interested in your work and would like to follow up on your work. Will you make the pre-training code and training dataset public?

[invictus717]

Yes! We promise all these data and code will be publicly available. We are hard-working cleaning up code and preparing documents for pretraining, fine-tuning, and instruction tuning with LLMs, while the only problem is such a huge engineering task.
We plan to release a series of pretrained multimodal LLMs in these several days.

[handsomelys]

Yes! We promise all these data and code will be publicly available. We are hard-working cleaning up code and preparing documents for pretraining, fine-tuning, and instruction tuning with LLMs, while the only problem is such a huge engineering task. We plan to release a series of pretrained multimodal LLMs in these several days.

This is so exciting! I’m really looking forward to your follow-up work!