Search results

Quantification time is too long

Status: Open.

#10 In nbasyl/LLM-FP4;

· qxpBlog opened on Aug 31, 2024

question about Eq. 8

Status: Open.

#9 In nbasyl/LLM-FP4;

· goldberg2024 opened on Jan 30, 2024

LLM-FP4 model inference problem

Status: Open.

#8 In nbasyl/LLM-FP4;

· zhangqq1985 opened on Jan 23, 2024

question about fp4 input and weight matrix multipy.

Status: Open.

#7 In nbasyl/LLM-FP4;

· dulvqingyunLT opened on Jan 22, 2024

runtime error: BuilderConfig 'allenai--c4' not found. Available: ['en', 'en.noblocklist', 'en.noclean', ...

Status: Open.

#6 In nbasyl/LLM-FP4;

· goldberg2024 opened on Jan 19, 2024

activation and weight tensor with 15 distinct values

Status: Open.

#5 In nbasyl/LLM-FP4;

· dulvqingyunLT opened on Jan 19, 2024

question of scale factors.

Status: Open.

#4 In nbasyl/LLM-FP4;

· dulvqingyunLT opened on Jan 17, 2024

how to quantize the attention head?

Status: Open.

#3 In nbasyl/LLM-FP4;

· dulvqingyunLT opened on Jan 15, 2024

cuda driver

Status: Open.

#2 In nbasyl/LLM-FP4;

· muzi002 opened on Dec 7, 2023

关于何时能够开源代码

Status: Open.

#1 In nbasyl/LLM-FP4;

· cxy0022 opened on Nov 1, 2023