Visual Document Retrieval
Transformers
Safetensors
ColPali
English
ultravbert
fill-mask
ultrabert
vision-language
multimodal
document-retrieval
vidore
custom_code
Instructions to use athrael-soju/UltraVBERT with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use athrael-soju/UltraVBERT with Transformers:
# pip install -U transformers accelerate # Load model directly from transformers import AutoProcessor, AutoModelForMaskedLM processor = AutoProcessor.from_pretrained("athrael-soju/UltraVBERT", trust_remote_code=True) model = AutoModelForMaskedLM.from_pretrained("athrael-soju/UltraVBERT", trust_remote_code=True, device_map="auto") - ColPali
How to use athrael-soju/UltraVBERT with ColPali:
# No code snippets available yet for this library. # To use this model, check the repository files and the library's documentation. # Want to help? PRs adding snippets are welcome at: # https://github.com/huggingface/huggingface.js
- Notebooks
- Google Colab
- Kaggle
Download processor_config.json from athrael-soju/UltraVBERT: direct link, hf CLI and curl.
- Browser
- Download file 723 Bytes
-
https://huggingface.co/athrael-soju/UltraVBERT/resolve/main/processor_config.json
- Command line
-
hf download hf://athrael-soju/UltraVBERT/processor_config.json
-
curl -L -o processor_config.json https://huggingface.co/athrael-soju/UltraVBERT/resolve/main/processor_config.json
723 Bytes
| { | |
| "image_processor": { | |
| "do_convert_rgb": true, | |
| "do_image_splitting": true, | |
| "do_normalize": true, | |
| "do_pad": true, | |
| "do_rescale": true, | |
| "do_resize": true, | |
| "image_mean": [ | |
| 0.5, | |
| 0.5, | |
| 0.5 | |
| ], | |
| "image_processor_type": "UltraVBertImageProcessor", | |
| "image_std": [ | |
| 0.5, | |
| 0.5, | |
| 0.5 | |
| ], | |
| "max_image_size": { | |
| "longest_edge": 512 | |
| }, | |
| "max_image_tiles": 27, | |
| "resample": 1, | |
| "rescale_factor": 0.00392156862745098, | |
| "size": { | |
| "longest_edge": 3072 | |
| }, | |
| "auto_map": { | |
| "AutoImageProcessor": "image_processing_ultravbert.UltraVBertImageProcessor" | |
| } | |
| }, | |
| "image_seq_len": 64, | |
| "processor_class": "Idefics3Processor" | |
| } | |