o
hiA @ s d dl Z d dlZd dlmZ d dlmZmZ d dlmZm Z m
Z
m Z m Z d dl
mZ d dlmZmZ d dlmZ d dlmZmZmZmZ d d
lmZmZ d d l m Z e e Z
d4de!de!fddZ"
d4de!de!de!fddZ#dZ$de de de dZ%defdd Z&defd d Z' d5d e e!ef d e e e!ef fd!d"Z(e d5d#e!d$e e! fd%d&Z)ed'dddddddddd(
d#e!d)e!d*e e* d+e e! d e e+ d,e e! d-e e* d.e e e
e! e!f d/e e e
e! e!f d0e e e
e! e!f d1e e! fd2d3Z,dS )6 N)Path)DEFAULT_PROTOCOL
PicklingError)AnyDictListOptionalUnion)version) constantssnapshot_download)HfApi)SoftTemporaryDirectoryget_fastai_versionget_fastcore_versionget_python_version )loggingvalidate_hf_hub_args) _PY_VERSION2.41.3.27fastai_min_versionfastcore_min_versionc
C s t pt dkrtd| d| dt dt d tt }tt }|t| k r:td| dt d |t|k rMtd
| d t d d
S )a+
Checks that the installed fastai and fastcore versions are compatible for pickle serialization.
Args:
fastai_min_version (`str`, *optional*):
The minimum fastai version supported.
fastcore_min_version (`str`, *optional*):
The minimum fastcore version supported.
Raises the following error:
- [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError)
if the fastai or fastcore libraries are not available or are of an invalid version.
zN/Azfastai>=z and fastcore>=z' are required. Currently using fastai==z and fastcore==.zD`push_to_hub_fastai` and `from_pretrained_fastai` require a fastai>=z+ version, but you are using fastai version zA which is incompatible. Upgrade with `pip install fastai==2.5.6`.zF`push_to_hub_fastai` and `from_pretrained_fastai` require a fastcore>=- version, but you are using fastcore version zD which is incompatible. Upgrade with `pip install fastcore==1.3.27`.N)r r ImportErrorr
Version)r r current_fastai_versioncurrent_fastcore_version r p/var/www/html/construction_image-detection-poc/venv/lib/python3.10/site-packages/huggingface_hub/fastai_utils.py _check_fastai_fastcore_versions s6 r" storage_folderc C s~ zddl }W n ty tdw tj| ds"td dS || d}d| vr7td dS |d }d| vrHtd dS |d }d
d |D }t
|dkr_td n$t |d d
d }|dkrt
|t
|k rtd| d| ddd |D } t
| dkrtd dS t | d d
d }
|
dkrt
|
t
|k rtd| d|
ddS dS )a
Checks that the `pyproject.toml` file in the directory `storage_folder` has fastai and fastcore versions
that are compatible with `from_pretrained_fastai` and `push_to_hub_fastai`. If `pyproject.toml` does not exist
or does not contain versions for fastai and fastcore, then it logs a warning.
Args:
storage_folder (`str`):
Folder to look for the `pyproject.toml` file.
fastai_min_version (`str`, *optional*):
The minimum fastai version supported.
fastcore_min_version (`str`, *optional*):
The minimum fastcore version supported.
Raises the following errors:
- [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError)
if the `toml` module is not installed.
- [`ImportError`](https://docs.python.org/3/library/exceptions.html#ImportError)
if the `pyproject.toml` indicates a lower than minimum supported version of fastai or fastcore.
r Nzn`push_to_hub_fastai` and `from_pretrained_fastai` require the toml module. Install it with `pip install toml`.z/pyproject.tomlzThere is no `pyproject.toml` in the repository that contains the fastai `Learner`. The `pyproject.toml` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.z build-systemzThere is no `build-system` section in the pyproject.toml of the repository that contains the fastai `Learner`. The `build-system` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.requireszThere is no `requires` section in the pyproject.toml of the repository that contains the fastai `Learner`. The `requires` would allow us to verify that your fastai and fastcore versions are compatible with those of the model you want to load.c S g | ] }| d r|qS )fastai
startswith.0pckr r r!
z=_check_fastai_fastcore_pyproject_versions..zPThe repository does not have a fastai version specified in the `pyproject.toml`.= z*`from_pretrained_fastai` requires fastai>=z$ version but the model to load uses z which is incompatible.c S r% )fastcorer' r) r r r! r, r- zRThe repository does not have a fastcore version specified in the `pyproject.toml`.z,`from_pretrained_fastai` requires fastcore>=r )tomlModuleNotFoundErrorr ospathisfileloggerwarningloadkeyslenstr partitionr
r ) r# r r r2 pyproject_tomlbuild_system_tomlpackage_versionsfastai_packagesfastai_versionfastcore_packagesfastcore_versionr r r! )_check_fastai_fastcore_pyproject_versionsJ sd rE u ---
tags:
- fastai
---
# Amazing!
🥳 Congratulations on hosting your fastai model on the Hugging Face Hub!
# Some next steps
1. Fill out this model card with more information (see the template below and the [documentation here](https://huggingface.co/docs/hub/model-repos))!
2. Create a demo in Gradio or Streamlit using 🤗 Spaces ([documentation here](https://huggingface.co/docs/hub/spaces)).
3. Join the fastai community on the [Fastai Discord](https://discord.com/invite/YKrxeNn)!
Greetings fellow fastlearner 🤝! Don't forget to delete this content from your model card.
---
# Model card
## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
zB[build-system]
requires = ["setuptools>=40.8.0", "wheel", "python=z ", "fastai=z
", "fastcore=z6"]
build-backend = "setuptools.build_meta:__legacy__"
repo_dirc C R | d }| s'|jddd}|t W d dS 1 s w Y dS dS )z
Creates a model card for the repository.
Args:
repo_dir (`Path`):
Directory where model card is created.
z README.mdwutf-8encodingN)existsopenwriteREADME_TEMPLATE)rF readme_pathfr r r! _create_model_card "rR c C rG )z
Creates a `pyproject.toml` for the repository.
Args:
repo_dir (`Path`):
Directory where `pyproject.toml` is created.
zpyproject.tomlrH rI rJ N)rL rM rN PYPROJECT_TEMPLATE)rF pyproject_pathrQ r r r! _create_model_pyproject rS rV save_directoryconfigc C s t tj|dd |dur@t|ts tdt| dtj|t j
}t |d}t
|| W d n1 s;w Y tt| tt| t|| _tj|dd z
| jdtd W dS tym td w )
a
Saves a fastai learner to `save_directory` in pickle format using the default pickle protocol for the version of python used.
Args:
learner (`Learner`):
The `fastai.Learner` you'd like to save.
save_directory (`str` or `Path`):
Specific directory in which you want to save the fastai learner.
config (`dict`, *optional*):
Configuration object. Will be uploaded as a .json file. Example: 'https://huggingface.co/espejelomar/fastai-pet-breeds-classification/blob/main/config.json'.
Raises the following error:
- [`RuntimeError`](https://docs.python.org/3/library/exceptions.html#RuntimeError)
if the config file provided is not a dictionary.
T)exist_okNz(Provided config should be a dict. Got: ''rH model.pkl)fnamepickle_protocolzYou are using a lambda function, i.e., an anonymous function. `pickle` cannot pickle function objects and requires that all functions have names. One possible solution is to name the function.)r" r4 makedirs
isinstancedict RuntimeErrortyper5 joinr CONFIG_NAMErM jsondumprR r rV exportr r )learnerrW rX r5 rQ r r r! _save_pretrained_fastai s.
ri repo_idrevisionc C sP t tj| st| |dt d}n| }t| ddlm} |tj |dS )ap
Load pretrained fastai model from the Hub or from a local directory.
Args:
repo_id (`str`):
The location where the pickled fastai.Learner is. It can be either of the two:
- Hosted on the Hugging Face Hub. E.g.: 'espejelomar/fatai-pet-breeds-classification' or 'distilgpt2'.
You can add a `revision` by appending `@` at the end of `repo_id`. E.g.: `dbmdz/bert-base-german-cased@main`.
Revision is the specific model version to use. Since we use a git-based system for storing models and other
artifacts on the Hugging Face Hub, it can be a branch name, a tag name, or a commit id.
- Hosted locally. `repo_id` would be a directory containing the pickle and a pyproject.toml
indicating the fastai and fastcore versions used to build the `fastai.Learner`. E.g.: `./my_model_directory/`.
revision (`str`, *optional*):
Revision at which the repo's files are downloaded. See documentation of `snapshot_download`.
Returns:
The `fastai.Learner` model in the `repo_id` repo.
r& )rj rk library_namelibrary_versionr ) load_learnerr[ )
r" r4 r5 isdirr r rE fastai.learnerrn rc )rj rk r# rn r r r! from_pretrained_fastai) s rq z(Push FastAI model using huggingface_hub.)
commit_messageprivatetokenrX branch create_prallow_patternsignore_patternsdelete_patterns api_endpointrr rs rt ru rv rw rx ry rz c C s t t| d} | j|||ddj}t #}
t|
| }t| ||d | j|||||||| |
d W d S 1 s;w Y dS )a
Upload learner checkpoint files to the Hub.
Use `allow_patterns` and `ignore_patterns` to precisely filter which files should be pushed to the hub. Use
`delete_patterns` to delete existing remote files in the same commit. See [`upload_folder`] reference for more
details.
Args:
learner (`Learner`):
The `fastai.Learner' you'd like to push to the Hub.
repo_id (`str`):
The repository id for your model in Hub in the format of "namespace/repo_name". The namespace can be your individual account or an organization to which you have write access (for example, 'stanfordnlp/stanza-de').
commit_message (`str`, *optional*):
Message to commit while pushing. Will default to :obj:`"add model"`.
private (`bool`, *optional*):
Whether or not the repository created should be private.
If `None` (default), will default to been public except if the organization's default is private.
token (`str`, *optional*):
The Hugging Face account token to use as HTTP bearer authorization for remote files. If :obj:`None`, the token will be asked by a prompt.
config (`dict`, *optional*):
Configuration object to be saved alongside the model weights.
branch (`str`, *optional*):
The git branch on which to push the model. This defaults to
the default branch as specified in your repository, which
defaults to `"main"`.
create_pr (`boolean`, *optional*):
Whether or not to create a Pull Request from `branch` with that commit.
Defaults to `False`.
api_endpoint (`str`, *optional*):
The API endpoint to use when pushing the model to the hub.
allow_patterns (`List[str]` or `str`, *optional*):
If provided, only files matching at least one pattern are pushed.
ignore_patterns (`List[str]` or `str`, *optional*):
If provided, files matching any of the patterns are not pushed.
delete_patterns (`List[str]` or `str`, *optional*):
If provided, remote files matching any of the patterns will be deleted from the repo.
Returns:
The url of the commit of your model in the given repository.
Raises the following error:
- [`ValueError`](https://docs.python.org/3/library/exceptions.html#ValueError)
if the user is not log on to the Hugging Face Hub.
)endpointT)rj rt rs rY )rX ) rj rt folder_pathrr rk rv rw rx ry N)r" r
create_reporj r r ri
upload_folder)rh rj rr rs rt rX ru rv rw rx ry rz apitmp
saved_pathr r r! push_to_hub_fastaiV s$ A
$r )r r )N)-re r4 pathlibr pickler r typingr r r r r packagingr
huggingface_hubr r huggingface_hub.hf_apir
huggingface_hub.utilsr r r r utilsr r utils._runtimer
get_logger__name__r7 r< r" rE rO rT rR rV ri rq boolr` r r r r r! s
3
a"
8 ,