Mayank Bhaskar's picture

Mayank Bhaskar

cataluna84

·

AI & ML interests

Research interest includes anything that moves or in processing things that are on the audible spectrum and has recently been seduced by RL Theory, GNNs, Transformers & applications of them in solving self-driving autonomous systems including vehicles, drones, and robots.

Articles

Fine tuning CLIP with Remote Sensing (Satellite) images and captions

Organizations

cataluna84's activity

upvoted an article 1 day ago

Article

Fine-tuning LLMs to 1.58bit: extreme quantization made easy

2 days ago

• 99

upvoted a paper 3 days ago

Probabilistic Inference in Language Models via Twisted Sequential Monte Carlo

Paper • 2404.17546 • Published Apr 26 • 1

upvoted an article 6 days ago

Article

Accelerate 1.0.0

7 days ago

• 31

upvoted 2 papers 8 days ago

Text-to-Image Generation Via Energy-Based CLIP

Paper • 2408.17046 • Published 21 days ago • 2

The AdEMAMix Optimizer: Better, Faster, Older

Paper • 2409.03137 • Published 15 days ago • 3

upvoted an article 13 days ago

Article

ColPali: Efficient Document Retrieval with Vision Language Models 👀

By

•

Jul 5

• 85

upvoted a collection 14 days ago

LLaVA-Onevision

LLaVa_Onevision models for single-image, multi-image, and video scenarios • 9 items • Updated 1 day ago • 8

upvoted a paper 15 days ago

Compositional 3D-aware Video Generation with LLM Director

Paper • 2409.00558 • Published 19 days ago • 14

upvoted 4 collections 15 days ago

Video-LLaVA 1.5 Model

a collection of Video-LLaVA 1.0 • 1 item • Updated Jan 28 • 2

Video-LLaVA 1.0 Model

a collection of Video-LLaVA 1.0 • 3 items • Updated May 23 • 5

LanguageBind 1.5 Model

a collection of LanguageBind based on VIDAL-45M • 2 items • Updated May 23 • 2

LanguageBind 1.0 Model

a collection of LanguageBind based on VIDAL-10M • 9 items • Updated Jan 28 • 4

upvoted 3 papers 15 days ago

VideoLLaMB: Long-context Video Understanding with Recurrent Memory Bridges

Paper • 2409.01071 • Published 18 days ago • 26

ImageInWords: Unlocking Hyper-Detailed Image Descriptions

Paper • 2405.02793 • Published May 5 • 4

OLMoE: Open Mixture-of-Experts Language Models

Paper • 2409.02060 • Published 16 days ago • 74

upvoted a paper 16 days ago

Mini-Omni: Language Models Can Hear, Talk While Thinking in Streaming

Paper • 2408.16725 • Published 21 days ago • 49

upvoted an article 17 days ago

Article

Fine tuning CLIP with Remote Sensing (Satellite) images and captions

Oct 13, 2021

• 4

upvoted 2 papers 18 days ago

ReMamba: Equip Mamba with Effective Long-Sequence Modeling

Paper • 2408.15496 • Published 23 days ago • 10

CogVLM2: Visual Language Models for Image and Video Understanding

Paper • 2408.16500 • Published 22 days ago • 55

upvoted a paper 20 days ago

Law of Vision Representation in MLLMs

Paper • 2408.16357 • Published 22 days ago • 92

upvoted 3 collections 20 days ago

C4AI Aya 23

Aya 23 is an open weights research release of an instruction fine-tuned model with highly advanced multilingual capabilities. • 4 items • Updated Aug 6 • 45

C4AI Command R

C4AI Command-R is a research release of a 35 billion parameter highly performant generative model. Command-R is a large language model with open weigh • 4 items • Updated 21 days ago • 15

C4AI Command R Plus

C4AI Command R+ is an open weights research release of a 104B billion parameter model with highly advanced capabilities. • 4 items • Updated 21 days ago • 38

upvoted a paper 21 days ago

LLaVA-MoD: Making LLaVA Tiny via MoE Knowledge Distillation

Paper • 2408.15881 • Published 22 days ago • 20

upvoted 2 collections 21 days ago

Qwen2-VL

Vision-language model series based on Qwen2 • 15 items • Updated 1 day ago • 114

NVEagle

4 items • Updated 22 days ago • 11

upvoted 2 papers 21 days ago

Mini-Gemini: Mining the Potential of Multi-modality Vision Language Models

Paper • 2403.18814 • Published Mar 27 • 44

Eagle: Exploring The Design Space for Multimodal LLMs with Mixture of Encoders

Paper • 2408.15998 • Published 22 days ago • 81

upvoted a paper 22 days ago

Towards Realistic Example-based Modeling via 3D Gaussian Stitching

Paper • 2408.15708 • Published 23 days ago • 7

upvoted 7 papers 23 days ago

Learning to Move Like Professional Counter-Strike Players

Paper • 2408.13934 • Published 25 days ago • 21

Foundation Models for Music: A Survey

Paper • 2408.14340 • Published 24 days ago • 38

Diffusion Models Are Real-Time Game Engines

Paper • 2408.14837 • Published 24 days ago • 119

The Mamba in the Llama: Distilling and Accelerating Hybrid Models

Paper • 2408.15237 • Published 23 days ago • 36

Model Compression and Efficient Inference for Large Language Models: A Survey

Paper • 2402.09748 • Published Feb 15 • 1

A Survey on Efficient Inference for Large Language Models

Paper • 2404.14294 • Published Apr 22 • 1

A Survey on Model Compression for Large Language Models

Paper • 2308.07633 • Published Aug 15, 2023 • 3

upvoted a collection 23 days ago

Model Compression & Inference Survey Papers

3 items • Updated 23 days ago • 1

upvoted 4 papers 24 days ago

LaCo: Large Language Model Pruning via Layer Collapse

Paper • 2402.11187 • Published Feb 17 • 2

Streamlining Redundant Layers to Compress Large Language Models

Paper • 2403.19135 • Published Mar 28 • 1

Sheared LLaMA: Accelerating Language Model Pre-training via Structured Pruning

Paper • 2310.06694 • Published Oct 10, 2023 • 4

A Simple and Effective Pruning Approach for Large Language Models

Paper • 2306.11695 • Published Jun 20, 2023 • 3

upvoted a collection 24 days ago

Datasets

20 items • Updated 24 days ago • 1

upvoted 15 papers 24 days ago

Pruning as a Domain-specific LLM Extractor

Paper • 2405.06275 • Published May 10 • 1

Building and better understanding vision-language models: insights and future directions

Paper • 2408.12637 • Published 28 days ago • 109

Distilling Step-by-Step! Outperforming Larger Language Models with Less Training Data and Smaller Model Sizes

Paper • 2305.02301 • Published May 3, 2023 • 2

On-Policy Distillation of Language Models: Learning from Self-Generated Mistakes

Paper • 2306.13649 • Published Jun 23, 2023 • 14

Distil-Whisper: Robust Knowledge Distillation via Large-Scale Pseudo Labelling

Paper • 2311.00430 • Published Nov 1, 2023 • 56

A Survey on Knowledge Distillation of Large Language Models

Paper • 2402.13116 • Published Feb 20 • 2

Less is More: Task-aware Layer-wise Distillation for Language Model Compression

Paper • 2210.01351 • Published Oct 4, 2022 • 1

LLM-Pruner: On the Structural Pruning of Large Language Models

Paper • 2305.11627 • Published May 19, 2023 • 3

SparseGPT: Massive Language Models Can Be Accurately Pruned in One-Shot

Paper • 2301.00774 • Published Jan 2, 2023 • 3

Reducing Transformer Key-Value Cache Size with Cross-Layer Attention

Paper • 2405.12981 • Published May 21 • 28

AWQ: Activation-aware Weight Quantization for LLM Compression and Acceleration

Paper • 2306.00978 • Published Jun 1, 2023 • 8

GPTQ: Accurate Post-Training Quantization for Generative Pre-trained Transformers

Paper • 2210.17323 • Published Oct 31, 2022 • 7

EfficientQAT: Efficient Quantization-Aware Training for Large Language Models

Paper • 2407.11062 • Published Jul 10 • 8

Relational Knowledge Distillation

Paper • 1904.05068 • Published Apr 10, 2019 • 1

DistiLLM: Towards Streamlined Distillation for Large Language Models

Paper • 2402.03898 • Published Feb 6 • 1

upvoted 3 collections 24 days ago

Quantization

3 items • Updated 24 days ago • 1

Pruning

14 items • Updated 24 days ago • 1

Knowledge Distillation

12 items • Updated 24 days ago • 1