Epic: Modalities Version 1.0 #367

New issue

Copy link

New issue

Copy link

Open

8 / 258 of 25 issues completed

Open

Epic: Modalities Version 1.0#367

8 / 258 of 25 issues completed

Copy link

Assignees

Description

le1nux

opened on May 24, 2025

Issue body actions

No description provided.

Reactions are currently unavailable

Activity

1. le1nux

   added sub-issues on May 24, 2025

   • Tutorial for continued pre-trainnig of a HF-imported mode #368
   • Support for standard instruction-tuning #369
   • Tutorial for instruction tuning of a HF-imported model #370
   • Tutorial for evaluation of a pretrained or instruction-tuned model #371
2. le1nux

   self-assigned this

   on May 24, 2025
3. le1nux

   added sub-issues on Jun 2, 2025

   • Tutorial on scaling up model training (Troughput Profiler) #372
   • Check if all InstantiationModels require all of the specified top-level components #373
4. le1nux

   added a sub-issue on Jun 16, 2025

   • Reduce / clean up console logging #376
5. le1nux

   added sub-issues on Oct 10, 2025

   • Redundant training config parameter ffn_hidden in the case of SwiGLU #276
   • Consistency issue with max_length flag in tokenizer #274
   • Some tests are not included in testing #286
   • FSDP2: Full Activation Checkpointing does not work with torch.compile #361
6. le1nux

   changed the title [-]Epic: Version 1.0[/-] [+]Epic: Modalities Version 1.0[/+] on May 4, 2026
7. le1nux

   added sub-issues on May 4, 2026

   • Time logging checkpointing #204
   • Modalities expects JSONL to have a trailing \n for the last JSON document (best practice but not guaranteed by JSONL file format) #395
   • Hashing of config file content instead of config file path as part of the experiment_id #388
   • Consistency checks for weight initialization #438
   • Check Warmstart with PP #405
   • [ABL] Weight Tying raises errors when running distributed checkpointing #348

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Metadata

Metadata

Assignees

• 
  le1nux

Labels

No labels

No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions

• Open in GitHub Copilot app