DEDUPED Hot AI repos, turned into use cases Get 5 a day

What you can do with Open EBFM

OpenEBFM is open-source Python code for training, scaling, evaluating, and chatting with energy-based foundation language models.

Trended earlier

datamllab/OpenEBFM on GitHub

Third-party repos we don't own or vouch for. AI-generated use cases can be wrong: review everything and run at your own risk.

What do you want to do?

4 use cases

  • Pretrain an EBFM model to a chosen token budget

    Prepare DCLM data and run a full pretraining job with a set token count.

    View prompt
    Using the OpenEBFM repo (datamllab/OpenEBFM), prepare the dclm dataset and run pretraining with TARGET_TOTAL_TOKENS set to <token_budget> via runs/train.sh. Report the path of the final checkpoints_hf/ export and confirm it contains config.json and model.safetensors.

  • Chat with the published EBFM SFT model in a browser

    Serve the EBFM-FineWeb-1B-CHAT model through a local web chat interface.

    View prompt
    In the datamllab/OpenEBFM repo, start the web chat with runs/chat.sh using guan-wang/EBFM-FineWeb-1B-CHAT on host 0.0.0.0 and port <port>. Report the URL to open and confirm the server responds on that port.

  • Fine-tune a published EBFM checkpoint with SFT

    Start supervised fine-tuning from a Hugging Face EBFM model using the SFT launcher.

    View prompt
    In the datamllab/OpenEBFM repo, run runs/sft.sh with --finetuning_model_ckpt set to <hf_model_id> and --dataset_name set to <dataset_name>. Report the output directory and confirm checkpoints_hf/ was created.

  • Measure BPB and QA scores for an EBFM checkpoint

    Run position-wise BPB and QA evaluation on a published model and collect results.

    View prompt
    In the datamllab/OpenEBFM repo, run runs/eval.sh for BPB and runs/qa.sh for QA on the checkpoint <hf_model_id>, using the local snapshot directory for the tokenizer path. Report the results/ paths and confirm token_bytes.pt was found in the snapshot.

How to use Open EBFM

  1. Check you have what it needs: Python with uv installed; A GPU environment (the README installs the gpu extra and loads checkpoints with device="cuda"); Network access for data preparation and Hugging Face downloads.
  2. Open datamllab/OpenEBFM on GitHub and read the README and license.
  3. Run uv sync --extra gpu --extra hf --extra web to install the GPU, Hugging Face, and web-chat dependencies.
  4. Run source .venv/bin/activate to activate the environment.
  5. Run bash runs/prepare_data.sh --datasets dclm on a machine with network access to download and tokenize DCLM.
  6. Run TARGET_TOTAL_TOKENS=100000000 bash runs/train.sh to start pretraining with a 100M token budget.

These steps come from our top use case, Pretrain an EBFM model to a chosen token budget, which also has a copy-paste agent prompt.

Open EBFM alternatives · Best AI repos for Research

About this repo

  • Who it is forMachine learning researchers and engineers with GPU access who want to pretrain, fine-tune, or evaluate energy-based language models.
  • Why it is hot
  • LanguagePython
  • Sourcegithub.com/datamllab/OpenEBFM · Back to Hot repos

Requirements

  • Python with uv installed
  • A GPU environment (the README installs the gpu extra and loads checkpoints with device="cuda")
  • Network access for data preparation and Hugging Face downloads
  • Enough disk space for the datasets and checkpoints (sizes are not stated in the README)
Maintain Open EBFM? Add the Featured on Deduped badge

Paste this into your README:

[![Featured on Deduped](https://dedupedai.com/badge/datamllab-openebfm.svg)](https://dedupedai.com/use-cases/datamllab-openebfm/?ref=badge)

More badge styles and HTML

Questions about Open EBFM

What is Open EBFM?

OpenEBFM is open-source Python code for training, scaling, evaluating, and chatting with energy-based foundation language models. It is an open-source project on GitHub: https://github.com/datamllab/OpenEBFM.

Who is Open EBFM for?

Machine learning researchers and engineers with GPU access who want to pretrain, fine-tune, or evaluate energy-based language models.

What can I do with Open EBFM?

4 use cases so far, for example: Pretrain an EBFM model to a chosen token budget; Chat with the published EBFM SFT model in a browser; Fine-tune a published EBFM checkpoint with SFT. Each has steps and a copy-paste agent prompt.

What do I need to run Open EBFM?

Python with uv installed; A GPU environment (the README installs the gpu extra and loads checkpoints with device="cuda"); Network access for data preparation and Hugging Face downloads; Enough disk space for the datasets and checkpoints (sizes are not stated in the README).

What are alternatives to Open EBFM?

Other hot AI repos in Research: Scientific Agent Skills, Speaker Mem R1, DSH Council, Evo Bot, AI Engineering Course.

Is Open EBFM safe to run?

Deduped does not own, audit or vouch for it. Read the README and license, run it on your own systems first and review every command before you run it.