Search results

[Question] Pattern Search Not Working Anymore?

bugSomething isn't workingSomething isn't working

Status: Open.

#110 In microsoft/MInference;

· rebemika-amzn opened on Jan 8, 2025

[Question]: How to find those attention sparse patterns?

questionFurther information is requestedFurther information is requested

Status: Open.

#109 In microsoft/MInference;

· RussellCandy opened on Jan 7, 2025

[Question]: different eval results compared to the results in paper

questionFurther information is requestedFurther information is requested

Status: Open.

#99 In microsoft/MInference;

· unicorneeee opened on Dec 19, 2024

[Question]: What are the definitions of the different stages?

questionFurther information is requestedFurther information is requested

Status: Open.

#98 In microsoft/MInference;

· crazyofapple opened on Dec 19, 2024

[Question]: How to apply MInference on multiple A100 GPUs?

questionFurther information is requestedFurther information is requested

Status: Open.

#95 In microsoft/MInference;

· XiongxiaoL opened on Dec 13, 2024

[Question]: How to understand dense_decoding?

questionFurther information is requestedFurther information is requested

Status: Open.

#94 In microsoft/MInference;

· lemyx opened on Dec 13, 2024

[Question]: when searching the best sparse attention type ,why to caculate the score just pick the 2500 cols?

questionFurther information is requestedFurther information is requested

Status: Open.

#92 In microsoft/MInference;

· unicorneeee opened on Dec 11, 2024

[Question]:Code related question: Is the search just for the first batch of dataset?

questionFurther information is requestedFurther information is requested

Status: Open.

#91 In microsoft/MInference;

· unicorneeee opened on Dec 9, 2024

[Question]: vllm-tp generate can't stop

questionFurther information is requestedFurther information is requested

Status: Open.

#90 In microsoft/MInference;

· unicorneeee opened on Dec 4, 2024

[Question]: RuntimeError encountered when trying to reproduce results in needle in a haystack

questionFurther information is requestedFurther information is requested

Status: Open.

#88 In microsoft/MInference;

· lepangdan opened on Nov 26, 2024

[Question]: How can I reproduce the FullAttention results on the Ruler dataset

questionFurther information is requestedFurther information is requested

Status: Open.

#87 In microsoft/MInference;

· LfieLike opened on Nov 25, 2024

[Feature Request]: Is it possible to get the returned logsumexp in streamingllm forward?

feature requestNew feature or requestNew feature or request

Status: Open.

#85 In microsoft/MInference;

· 311dada opened on Nov 17, 2024