baichuan-inc/Baichuan-13B-Chat

Request: DOI

#49 opened about 5 hours ago by

tanyawalia

Adding `safetensors` variant of this model

#48 opened about 1 year ago by

SFconvertbot

多伦对话，如何将背景信息，人设设定添加进去

#47 opened about 1 year ago by

leilei22

AttributeError: 'BaichuanTokenizer' object has no attribute '_in_target_context_manager'

#46 opened about 1 year ago by

DavidRay000977

使用 3090 显卡本地部署 baichuan2-13b-chat 非量化版，有人成功过没？

#45 opened over 1 year ago by

catlenmao

Update tokenization_baichuan.py

#44 opened over 1 year ago by

Beilei518

Baichuan doesn't work well when use AutoModelForCausalLM.from_config

#43 opened over 1 year ago by

baodii

update modeling_baichuan.py for torchscript mode with past_kv

#42 opened over 1 year ago by

changwangss

请问这两个文件quantizer.py和generation_utils.py为什么没有下载

#41 opened over 1 year ago by

zhangqin28

有32k的么？或者更大的

1

#40 opened over 1 year ago by

LycheeX

请问int8 和 int4 用的量化方法是什么啊？

1

#39 opened over 1 year ago by

frankxyy

[AUTOMATED] Model Memory Requirements

#38 opened over 1 year ago by

model-sizer-bot

怎么从本地加载模型呢？

3

#37 opened over 1 year ago by

yizhiezi

Unable to load weights from pytorch checkpoint file

#36 opened over 1 year ago by

xiaofengzheng

13B的8bit量化版的下载链接咋没了呢

1

#35 opened over 1 year ago by

pbjacob

v2版本大概啥时候能开源出来

3

#33 opened over 1 year ago by

Winkuis

Model Export to ONNX format

2

#32 opened over 1 year ago by

Desjajja

关于量化8bits的推理速度

1

#31 opened over 1 year ago by

hanswang73

重复问题

#30 opened over 1 year ago by

hanswang73

自问自答

#29 opened over 1 year ago by

Xingloooooong

The model 'BaichuanForCausalLM' is not supported for text-generation.

#28 opened over 1 year ago by

fuliu2023

有支持FasterTransformer的计划吗？

3

#27 opened over 1 year ago by

Hunter1943

英文推理报错

19

#26 opened over 1 year ago by

hanswang73

有nl2sql的prompt示例吗

#25 opened over 1 year ago by

boundles

用英语提问，默认回答的是中文

1

#24 opened over 1 year ago by

xdstack

大家百川13b 推理加速是怎么做的？

2

#23 opened over 1 year ago by

yy520xxr

请问, 模型量化后如何保存,直接使用 save_pretrained 保存下来的不太正确只有1.3G

2

#22 opened over 1 year ago by

agoto

Add flash attention

7

#21 opened almost 2 years ago by

yuanzhoulvpi

跑这个需要什么机器配置，AMD 68xt能行？

1

#18 opened almost 2 years ago by

xebk

The sdk for running demo code.

#17 opened almost 2 years ago by

ljni

流式输出支持

1

#16 opened almost 2 years ago by

zhenghui

什么时候可以出baichuan-33B的版本呢

1

#13 opened almost 2 years ago by

DCTR

3060 12g demo代码可以跑起来 4090 24g内存溢出

6

#12 opened almost 2 years ago by

duketxl

能否出个deepspeed的微调DEMO

#11 opened almost 2 years ago by

robinzyx

设定的角色有哪些？

2

#9 opened almost 2 years ago by

feifeiyechuan

关于数据集的疑问

1

#7 opened almost 2 years ago by

ShadowPower

关于“对齐”

#4 opened almost 2 years ago by

Hans