Lithops-3.5.1

Fixed

• [Core] Fix issue in "if self._call_output in future.py" for objects with ambiguous truth values, by @cisaacstern
• [Standalone] Consume execution mode failing to run the installation script thus failing all the jobs, by @JosepSampe
• [Azure VMs] Consume execution mode failing to execute jobs, by @JosepSampe

Lithops-3.5.0

Added

• [Singularity] Added new singularity compute backend, by @macarronesc
• [Oracle Functions] Added support for python 3.11, by @JosepSampe
• [k8s] Added 'master_timeout' parameter to k8s backend, by @bystepii
• [AWS Lambda] Added user_tags to the runtime deployment, by @thodson-usgs

Fixed

• [Storage] Fixed "KeyError: 'monitoring_interval'" error when instantiating Storage() class, by @kikemolina3
• [k8s] Fixed bug between threads when there are multiple executions, by @macarronesc
• [OpenWhisk] Fixed issue in the list_runtimes method, by @JosepSampe
• [OpenWhisk] Fixed runtime name formatting for self hosted container registries, by @JosepSampe

Lithops-3.4.1

Added

• [Localhost] Added error capturing and logging for job/task process failures, by @JosepSampe

Fixed

• [Worker] Fixed potential issue that can appear during 'func_obj' loading from cache, by @JosepSampe

Lithops-3.4.0

Added

• [CLI] Allow to pass a name in the 'lithops runtime list' command, by @JosepSampe
• [Ceph] Added extra region parameter to Ceph backend, by @abourramouss

Changed

• [Setup] Moved IBM and AWS deps to lithops[ibm] and lithops[aws] extra, by @tomwhite
• [Setup] Moved kubernetes and knative deps to lithops[kubernetes] and lithops[knative] extra, by @tomwhite
• [Setup] Moved minio, ceph and redis deps to lithops[minio], lithops[ceph] and lithops[redis] extra, by @tomwhite
• [Setup] Moved matplotlib, seaborn, numpy and pandas dependencies to lithops[plotting] extra, by @JosepSampe
• [Setup] Removed unused lxml, docker and python-dateutil packages, by @tomwhite
• [Core] Detached progress bar from INFO logs, by @rabernat
• [Future] Exposed wait_dur_sec and retries in future.wait() and future.get_result() methods, by @JosepSampe
• [Localhost] Upgraded localhost backend v2 and set it as the default localhost backend, by @JosepSampe
• [Localhost] Set monitoring_interval to 0.1 in the localhost storage backend, by @JosepSampe
• [AWS Batch] Updated CPU and Memory resource limits, by @JosepSampe

Fixed

• [AWS Lambda] Fixed wrong AWS Lambda delete runtime_name match semantics, by @tomwhite
• [Worker] Fixed potential issue that can appear during 'func_obj' loading from cache, by @JosepSampe
• [Monitor] Fixed potential 'keyerror' exceptions, by @JosepSampe
• [Swift] Fixed OpenStack Swift parameters and authentication by adding domain information, by @abourramouss
• [AWS Batch] Fixed missing ecsTaskJobRole, by @JosepSampe

---

⚠ BREAKING CHANGES

• [AWS] From now on, AWS dependencies must be installed using pip3 install lithops[aws]
• [IBM] From now on, IBM dependencies must be installed using pip3 install lithops[ibm]
• [Plotting] To use the plot() method, dependencies must be installed with pip3 install lithops[plotting]

Lithops-3.3.0

Added

• [Core] Added a mechanism to automatically retry failed tasks, by @tomwhite
• [Azure Containers] Automatically login to the container registry if the credentials are in the config, by @JosepSampe

Changed

• [AWS] Eliminated the need for access and secret keys in the configuration, by @JosepSampe
• [Tests] Moved tests from unittest to pytest, by @JosepSampe

Fixed

• [AWS Lambda] Fixed runtime deletion with "lithops runtime delete", by @JosepSampe
• [Localhost] Fixed issue with the job manager, by @JosepSampe
• [Serializer] Fix serialization bug which triggers side effects on dynamic attributes, by @rabernat
• [Worker] Removed "distutils" lib imports as it is deprecated in python 3.12, by @JosepSampe
• [Serverless] Allow to build container runtimes with the MacBook Mx chip, by @JosepSampe
• [K8s] Fixed task granularity calculation and memory units issue (RabbitMQ version), by @macarronesc
• [AWS Lambda] Fixed AWS Lambda function Name for SSO users, by @linuxkd
• [AWS] Fixed generated user-key for SSO users, by @JosepSampe
• [Azure VMs] Fixed worker creation and communication, by @JosepSampe

Lithops-3.2.0

Added

• [Lithops] Addded support for Python 3.12, by @JosepSampe
• [CLI] Added "--include" parameter in "lithops image build" to allow users upload local files to the VM image, by @JosepSampe

Changed

• [Standalone] Use redis in the master VM to store all the relevant data about jobs and workers, by @JosepSampe
• [Standalone] Use redis to store the work queues, by @JosepSampe
• [Standalone] Improved resiliency and worker granularity, by @JosepSampe
• [CLI] Show the timestamp in the local timezone format on "lithops job list", by @JosepSampe
• [CLI] Show worker creation timestamp and time-to-dismantle on "lithops worker list", by @JosepSampe

Fixed

• [SSH Cli] Fixed minor error with the "err" variable, by @JosepSampe
• [Cli] Fixed job status on "lithops job list" for standalone backends, by @JosepSampe
• [Standalone] Fixed issue in the "lithops image build" that appears when the vpc is already created, by @JosepSampe
• [Future] Fixed issue with missing 'worker_end_tstamp' variable, by @JosepSampe

Lithops-3.1.2

Added

• [Plots] Allow to set the figure size of the plots, by @JosepSampe
• [Stats] Added new CPU, Memory and Network statistics in the function results, by @Usamasource
• [IBM VPC] Added a new parameter to enable/disable resource existence check in the platform, by @JosepSampe

Changed

• [Config] Renamed 'customized_runtime' to 'runtime_include_function', by @JosepSampe
• [IBM VPC] Increased the total number of available IPs in the private network, by @JosepSampe
• [Standalone] Do not stop the VM immediately after a job in the Cosume mode, by @JosepSampe

Fixed

• [Standalone] Fixed issue that appears when the invocation payload is too big, by @JosepSampe
• [Invoker] Fixed "runtime_include_function" function/modules path, by @JosepSampe
• [AWS EC2] Reset the public IP address of the master VM on stop, by @JosepSampe

Lithops-3.1.1

Added

• [k8s] Added a new way of invoking functions using a RabbitMQ work queue, by @macarronesc
• [IBM VPC] Added "zone" config parameter, by @JosepSampe
• [IBM Code Engine] Get and print an error message in case of container execution failure, by @JosepSampe

Changed

• [Openwhisk] Updated default runtimes, by @JosepSampe

Fixed

• [Standalone] Fixed issue with a wrong value of "chunksize", by @JosepSampe
• [IBM Code Engine] Fixed missing parameter on clean, by @JosepSampe
• [Executor] Fixed potential deadlock in wait() and get_result() when an exception is produced in a function activation, by @JosepSampe

Lithops-3.1.0

Added

• [Cli] Added new 'lithops image delete' command for standalone backends, by @JosepSampe
• [Cli] Added new 'lithops job list' command for standalone backends, by @JosepSampe
• [Cli] Added new 'lithops worker list' command for standalone backends, by @JosepSampe
• [AWS EC2] Added delete_image() method for deleting VM images through the cli, by @JosepSampe
• [IBM VPC] Added delete_image() method for deleting VM images through the cli, by @JosepSampe
• [localhost] New localhost backend v2 to maximize resource utilization when multiple maps are executed from the same FunctionExecutor, by @JosepSampe
• [Standalone] Automatically retrieve the CPU_COUNT from the VM in case worker_processes is not set in config, by @JosepSampe
• [Standalone] Keep track of the worker and job status, by @JosepSampe
• [Storage] Include "Config" paramater to download_file() and upload_file() methods for boto3 related backends, by @JosepSampe
• [Cli] Include 'worker name' in the 'lithops runtime list' cmd, by @JosepSampe
• [AWS Lambda] Created 'namespace' config key to virtually separate worker deployments, by @JosepSampe

Changed

• [Standalone] Changed default mode of execution from 'consume' to 'reuse', by @JosepSampe
• [Joblib] Updated the joblib backend to make it compatible with new versions of joblib, by @JosepSampe
• [Joblib] Spawn only one function when 'prefer' is set to 'threads', by @JosepSampe
• [AWS EC2] Changed default image name from "lithops-worker-default" to "lithops-ubuntu-jammy-22.04-amd64-server", by @JosepSampe
• [IBM VPC] Changed default image name from "lithops-worker-default" to "lithops-ubuntu-22-04-3-minimal-amd64-1", by @JosepSampe
• [Serializer] Improve serializer performance when include_modules is set in config, by @JosepSampe
• [SSH Client] Do not raise LithopsValidationError on Authentication failed, by @JosepSampe
• [AWS Lambda] Renamed function name to "lithops-worker-xxxx", by @JosepSampe

Fixed

• [Job] Fixed max data size in the invocation payload, by @JosepSampe
• [Multiprocessing] Fixed cpu_count, by @JosepSampe
• [Standalone] Start new workers when the VM instance type changes (in reuse mode), by @JosepSampe
• [GCP Functions] Fixed issue with "function_url" variable, by @JosepSampe
• [Standalone] Fixed multiple runtime usage at the same time in master VM, by @JosepSampe
• [localhost] Get the correct docker/podman path for jobs that run in a container, by @JosepSampe
• [k8s] Limit the size of the "user" label as the maximum allowed is 63 chars, by @JosepSampe
• [Joblib] Fix shared objects utility when multiple maps run from the same executor, by @JosepSampe
• [Azure VMs] Fix wrong exception when trying to connect to the master VM for the first time, by @JosepSampe
• [Partitioner] Fixed partitioner, by @JosepSampe

---

⚠ BREAKING CHANGES

• [Standalone] Changed default mode of execution from 'consume' to 'reuse'

Lithops-3.0.1

New

• [OCI Functions] Added new 'Oracle Cloud Functions' serverless backend, by @abourramouss
• [OCI Object Storage] Added new 'Oracle Cloud Object storage' storage backend, by @abourramouss

Added

• [Kubernetes] Added Redis server in master pod for shared data between workers, by @JosepSampe
• [Kubernetes] Allow to set "conntext" and "namespace" in lithops config, by @JosepSampe

Changed

• [CodeEngine] Create the CE project only when necessary instead of creating it always, by @JosepSampe
• [IBM CF] Create the CF namespace only when necessary instead of creating it always, by @JosepSampe

Fixed

• [Executor] Fixed kwargs mapping in ServerlessExecutor and StandaloneExecutor, by @JosepSampe
• [Serializer] Fixed issue in serializer when "include_modules" config var is set, by @JosepSampe
• [CodeEngine] Fixed exception handling, by @JosepSampe