[D] How does visual embedding coexist with language embedding space in Vision Language Model?

Hello everyone! I'm excited to discuss about Large Vision Language Model (LVLM). Since we're probably the biggest community into LLMs, I thought this channel would be the perfect place to start this conversation. Also, there isn't much out there on combining vision and language embeddings.

A little background on LVLMs: They typically consist of a vision encoder for images, a regular tokenizer for text, a projection layer like an MLP to align vision features with text embedding spaces, and finally, …

community conversation discuss embedding embeddings hello isn language language model llms lvlm machinelearning space thought vision vision language model visual