Issues

• AttributeError: type object 'GenerationMixin' has no attribute 'greedy_search'

  hao-ai-lab/LookaheadDecoding#67 · Filter by author grandxin opened on Nov 5, 2024
  2

• Question about batching strategy

  hao-ai-lab/LookaheadDecoding#66 · Filter by author lxnlxnlxnlxnlxn opened on Oct 10, 2024

• Yi Models support

  hao-ai-lab/LookaheadDecoding#64 · Filter by author fayuge opened on Jun 17, 2024
  1

• How to optimize the scene with relatively short output?

  hao-ai-lab/LookaheadDecoding#63 · Filter by author yangbohust opened on Jun 4, 2024

• Bug in Greedy Search

  hao-ai-lab/LookaheadDecoding#62 · Filter by author david-wei-01001 opened on May 21, 2024

• Cannot use save_log and log_history

  hao-ai-lab/LookaheadDecoding#61 · Filter by author david-wei-01001 opened on May 17, 2024
  1

• about verification branch

  hao-ai-lab/LookaheadDecoding#60 · Filter by author dhcode-cpp opened on May 13, 2024
  1

• TypeError: LlamaSdpaAttention.forward() got an unexpected keyword argument 'lookahead'

  hao-ai-lab/LookaheadDecoding#59 · Filter by author zev123456 opened on Apr 25, 2024
  5

• How to use LADE in single-node multi-process way?

  hao-ai-lab/LookaheadDecoding#57 · Filter by author sjrrr13 opened on Apr 15, 2024
  2

• [BUG Report] jacobi_greedy_search_multilevel function bug

  hao-ai-lab/LookaheadDecoding#56 · Filter by author yangbohust opened on Apr 8, 2024
  1

• Do lookahead and repetition_penalty conflict?

  hao-ai-lab/LookaheadDecoding#55 · Filter by author zhanweiw opened on Apr 7, 2024

• BUG Report

  hao-ai-lab/LookaheadDecoding#54 · Filter by author yangbohust opened on Mar 26, 2024

• Why jacobi_sample_multilevel() fill window with argmax instead of also using sampling?

  hao-ai-lab/LookaheadDecoding#53 · Filter by author yangbohust opened on Mar 22, 2024

• question on verification beginning pos

  hao-ai-lab/LookaheadDecoding#52 · Filter by author felixdae opened on Mar 18, 2024
  1

• Adaptive LEVEL/GUESS size?

  hao-ai-lab/LookaheadDecoding#51 · Filter by author sahel-sh opened on Feb 28, 2024

• specific model

  hao-ai-lab/LookaheadDecoding#48 · Filter by author qspang opened on Jan 22, 2024
  13

• Multiple GPUS

  hao-ai-lab/LookaheadDecoding#47 · Filter by author qspang opened on Jan 20, 2024
  9

• Related work: Prompt lookup decoding

  hao-ai-lab/LookaheadDecoding#45 · Filter by author shermansiu opened on Jan 18, 2024
  7

• Questions on combined attention mask structure for Jacobi iteration

  hao-ai-lab/LookaheadDecoding#44 · Filter by author learning-chip opened on Jan 11, 2024
  23

• Can I get a MT-bench evaluation code for reproduction of acceleration?

  hao-ai-lab/LookaheadDecoding#36 · Filter by author je1lee opened on Dec 19, 2023
  11

• Questions on the attention mask, and whether to accept the last element of guess_results when all guess_tokens are accepted

  hao-ai-lab/LookaheadDecoding#32 · Filter by author YingHH1 opened on Dec 7, 2023
  6

• The inference results are inconsistent with Huggingface.

  hao-ai-lab/LookaheadDecoding#30 · Filter by author cyfwry opened on Dec 6, 2023
  6

• Does Lade support topp/topk/temperature sampleing?

  hao-ai-lab/LookaheadDecoding#29 · Filter by author AlvL1225 opened on Dec 6, 2023
  2

• Benchmarks comparing with Medusa

  hao-ai-lab/LookaheadDecoding#26 · Filter by author Rock-Anderson opened on Nov 30, 2023

• amazing work!! any plan support for chatglm or Qwen model?

  hao-ai-lab/LookaheadDecoding#22 · Filter by author white-wolf-tech opened on Nov 28, 2023
  1