Search results

How can i convert trained blip2 model to upload to huggingface

Status: Open.

#783 In salesforce/LAVIS;

· park1200656 opened on Jan 18, 2025

Getting error while Stage-1 Pre-training of BLIP2

Status: Open.

#782 In salesforce/LAVIS;

· parth1313 opened on Jan 16, 2025

Custom models for Qformer training

Status: Open.

#781 In salesforce/LAVIS;

· parth1313 opened on Jan 13, 2025

blip2_qformer train question

Status: Open.

#779 In salesforce/LAVIS;

· Codingfarmer-hkl opened on Jan 2, 2025

Using preprocess_phi_3_new in LAVIS/open_flamingo/train/sft_data_utils.py gets labels all -100.

Status: Open.

#776 In salesforce/LAVIS;

· JHW5981 opened on Dec 26, 2024

PIP ENV NEVER WORK

Status: Open.

#775 In salesforce/LAVIS;

· 5e1in opened on Dec 13, 2024

How do I evaluate the results after stage-1 of training BLIP2?

Status: Open.

#774 In salesforce/LAVIS;

· hawkiyc opened on Dec 12, 2024

RuntimeError: Error(s) in loading state_dict for Blip2OPT: size mismatch for opt_proj.weight: copying a param with shape torch.Size([2560, 768]) from checkpoint, the shape in current model is torch.Size([768, 768]). size mismatch for opt_proj.bias: copying a param with shape torch.Size([2560]) from checkpoint, the shape in current model is torch.Size([768]).

Status: Open.

#773 In salesforce/LAVIS;

· chilljudaoren opened on Dec 7, 2024

Issue related to BLIP2 CaptionDataset implementation or blip2_qformer.py for custom dataset pre-training stage 1

Status: Open.

#772 In salesforce/LAVIS;

· abdel-habib opened on Dec 4, 2024

RuntimeError: shape mismatch: value tensor of shape [131072] cannot be broadcast to indexing result of shape [0]

Status: Open.

#771 In salesforce/LAVIS;

· jyh-fort opened on Dec 4, 2024

text and image embedding from xgen-mm-phi3-mini-base-r-v1.5

Status: Open.

#770 In salesforce/LAVIS;

· sangeethkumar1997 opened on Dec 3, 2024

blip2_feature_extractor problem?

Status: Open.

#769 In salesforce/LAVIS;

· wahaha-debug opened on Dec 1, 2024