books/LLMs-from-scratch
1
0
Fork 0
mirror of https://github.com/rasbt/LLMs-from-scratch.git synced 2026-04-10 12:33:42 +00:00
Code Issues Packages Projects Releases Wiki Activity

feat: Add pixi environment (#534)

Browse Source 
* feat: Add pixi environment

* Add pixi manifest pixi.toml for Linux x86, macOS arm64, Windows 64.

* ci: Update CI workflow and unify to one

* Enable workflow dispatch.
* Add concurrency limits.
* Use pixi for CI workflow.
* Unify to a single workflow for all OS tested

* feat: Add pixi lock file

* Ensure tensorflow-cpu installed on Windows

* fix package check

* fix package check

* simplification plus uv and pip runners

* some fixes to pixi and pip

* create pixi.lock

* fix pixi.lock issue

* another attempt trying to fix get_packages

* another attempt trying to fix get_packages

* clean up python_environment_check.py

* updated runner and docs

* use bash

* proper env activiation

* proper env activiation

---------

Co-authored-by: rasbt <mail@sebastianraschka.com>
This commit is contained in:
Matthew Feickert
2025-02-17 10:33:53 -07:00
committed by GitHub
parent 16738b61fd
commit a8b8eb4731
14 changed files with 13169 additions and 222 deletions
Download Patch File Download Diff File Expand all files Collapse all files

48
setup/02_installing-python-libraries/python_environment_check.py
View File

@@ -3,7 +3,6 @@
# - https://www.manning.com/books/build-a-large-language-model-from-scratch
# Code: https://github.com/rasbt/LLMs-from-scratch
from importlib.metadata import PackageNotFoundError, import_module, version as get_version
from os.path import dirname, exists, join, realpath
from packaging.version import parse as version_parse
@@ -22,20 +21,45 @@ def get_packages(pkgs):
"""
Returns a dictionary mapping package names (in lowercase) to their installed version.
"""
PACKAGE_MODULE_OVERRIDES = {
"tensorflow-cpu": ["tensorflow", "tensorflow_cpu"],
}
result = {}
for p in pkgs:
try:
# Try to import the package
imported = import_module(p)
# Determine possible module names to try.
module_names = PACKAGE_MODULE_OVERRIDES.get(p.lower(), [p])
version_found = None
for module_name in module_names:
try:
version = getattr(imported, "__version__", None)
if version is None:
version = get_version(p)
result[p.lower()] = version
except PackageNotFoundError:
result[p.lower()] = "0.0"
except ImportError:
result[p.lower()] = "0.0"
imported = import_module(module_name)
version_found = getattr(imported, "__version__", None)
if version_found is None:
try:
version_found = get_version(module_name)
except PackageNotFoundError:
version_found = None
if version_found is not None:
break # Stop if we successfully got a version.
except ImportError:
# Also try replacing hyphens with underscores as a fallback.
alt_module = module_name.replace("-", "_")
if alt_module != module_name:
try:
imported = import_module(alt_module)
version_found = getattr(imported, "__version__", None)
if version_found is None:
try:
version_found = get_version(alt_module)
except PackageNotFoundError:
version_found = None
if version_found is not None:
break
except ImportError:
continue
continue
if version_found is None:
version_found = "0.0"
result[p.lower()] = version_found
return result