ChemDFM v1.0 13B 4-bit MLX

MLX version of ChemDFM v1.0 13B: An Large Language Foundation Model for Chemistry

This model was converted to MLX format from https://huggingface.co/OpenDFM/ChemDFM-v1.0-13B using mlx-lm version 0.22.1.

ChemDFM 13B is the pioneering open-sourced dialogue foundation model for Chemistry and molecule science. ChemDFM outperforms the open-sourced LLMs in all the typical tasks of chemistry, and even reach comparable or higher performances of GPT-4. For more details, please refer to paper.

Use with mlx

pip install -U mlx-lm
python -m mlx_lm.generate --model TheCluster/ChemDFM-v1.0-13B-mlx-4bit --max-tokens 1024 --temperature 0.5 --prompt "Can you please give detailed descriptions of the molecule below?\nCl.O=C1c2c(O)cccc2-c2nn(CCNCCO)c3ccc(NCCNCCO)c1c23"
Downloads last month
9
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for TheCluster/ChemDFM-v1.0-13B-mlx-4bit

Quantized
(9)
this model

Collection including TheCluster/ChemDFM-v1.0-13B-mlx-4bit