Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Neon Core 23.10.30 #570

Merged
merged 37 commits into from
Oct 30, 2023
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
37 commits
Select commit Hold shift + click to select a range
bfec04f
Update Docker for Compose v2 and Skill Updates (#551)
NeonDaniel Sep 19, 2023
082c88e
Increment Version to 23.9.19a1
NeonDaniel Sep 19, 2023
ff69f7d
Update config and dependencies to patch breaking changes (#552)
NeonDaniel Sep 20, 2023
c9cf8c2
Increment Version to 23.9.20a2
NeonDaniel Sep 20, 2023
79a311f
Add Python 3.11 tests (#554)
NeonDaniel Sep 27, 2023
2ca1974
Increment Version to 23.9.27a3
NeonDaniel Sep 27, 2023
df55f9e
Remove legacy skill management (#555)
NeonDaniel Sep 28, 2023
ba2d150
Increment Version to 23.9.28a4
NeonDaniel Sep 28, 2023
38d04a6
Update core modules and default skill (#557)
NeonDaniel Oct 4, 2023
02a4a24
Increment Version to 23.10.4a5
NeonDaniel Oct 4, 2023
291707c
Cleanup deprecated skill util references (#558)
NeonDaniel Oct 6, 2023
fad7621
Increment Version to 23.10.6a6
NeonDaniel Oct 6, 2023
1a84e80
Troubleshooting new GHA failure (#559)
NeonDaniel Oct 9, 2023
06d73ec
Increment Version to 23.10.9a7
NeonDaniel Oct 9, 2023
985a144
Update debos action to resolve compat. issue with neon-debos (#560)
NeonDaniel Oct 9, 2023
8df7025
Increment Version to 23.10.9a8
NeonDaniel Oct 9, 2023
115c31b
More platform-specific configurations (#556)
NeonDaniel Oct 10, 2023
8de5058
Increment Version to 23.10.10a9
NeonDaniel Oct 10, 2023
20510d2
Update skills dependencies for compat. and CommonQuery improvements (…
NeonDaniel Oct 10, 2023
a270fd5
Increment Version to 23.10.10a10
NeonDaniel Oct 10, 2023
bea6675
Support Future OVOS Changes, Minerva Testing/Benchmarking (#562)
NeonDaniel Oct 11, 2023
3acf674
Increment Version to 23.10.11a11
NeonDaniel Oct 11, 2023
d413f51
Update Dependencies (#563)
NeonDaniel Oct 13, 2023
1f1004b
Increment Version to 23.10.13a12
NeonDaniel Oct 13, 2023
f05771b
Update dependencies to validate latest ovos-config (#564)
NeonDaniel Oct 24, 2023
febf6d7
Increment Version to 23.10.24a13
NeonDaniel Oct 24, 2023
7d0eedd
Cleanup module init, update logging, update dependencies (#565)
NeonDaniel Oct 25, 2023
aefd0f2
Increment Version to 23.10.25a14
NeonDaniel Oct 25, 2023
ace6ab7
Update dependencies to resolve skill init bugs (#566)
NeonDaniel Oct 26, 2023
10b3d23
Increment Version to 23.10.26a15
NeonDaniel Oct 26, 2023
379ce8a
Update to test latest modules and prep for release (#567)
NeonDaniel Oct 26, 2023
475667b
Increment Version to 23.10.26a16
NeonDaniel Oct 26, 2023
5f5b4b9
Update speech and audio module dependencies (#568)
NeonDaniel Oct 26, 2023
387f968
Increment Version to 23.10.26a17
NeonDaniel Oct 26, 2023
187fdfd
Update dependencies to stable versions or pinned alpha versions (#569)
NeonDaniel Oct 28, 2023
2d9e0f0
Increment Version to 23.10.28a18
NeonDaniel Oct 28, 2023
1313379
Increment Version to 23.10.30
NeonDaniel Oct 30, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
12 changes: 9 additions & 3 deletions .github/workflows/build_debos.yml
Original file line number Diff line number Diff line change
Expand Up @@ -21,13 +21,19 @@ jobs:
repository: NeonGeckoCom/neon_debos
path: action/neon_debos
- name: Ensure LFS files are pulled
run: git lfs pull action/neon_debos
run: |
cd action/neon_debos
git lfs pull
cd ../..
- name: Export keys for image build
run: |
mkdir -p action/neon_debos/overlays/80-google-json-overlay/home/neon/.local/share/neon
echo ${GOOGLE_KEY}>action/neon_debos/overlays/80-google-json-overlay/home/neon/.local/share/neon/google.json
env:
GOOGLE_KEY: ${{secrets.google_api_key}}
- name: Build and Export Image
- name: Build and Export Mk2 Image
run: |
bash action/neon_debos/run_automation.sh debian-neon-image.yml ${{ github.ref_name }} /var/www/html/app/files/neon_images/pi/mycroft_mark_2 rpi4 mark_2
- name: Build and Export OPi5 Image
run: |
bash action/neon_debos/run_automation.sh debian-neon-image-rpi4.yml ${{ github.ref_name }} /var/www/html/app/files/neon_images/pi/mycroft_mark_2 ${{ github.ref_name }}
bash action/neon_debos/run_automation.sh debian-neon-image.yml ${{ github.ref_name }} /var/www/html/app/files/neon_images/orange_pi_5/ opi5 opi5
2 changes: 2 additions & 0 deletions .github/workflows/license_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -6,3 +6,5 @@ on:
jobs:
license_tests:
uses: neongeckocom/.github/.github/workflows/license_tests.yml@master
with:
packages-exclude: '^(precise-runner|fann2|tqdm|bs4|ovos-phal-plugin|ovos-skill|neon-core|nvidia|neon-phal-plugin|bitstruct|audioread).*'
17 changes: 17 additions & 0 deletions .github/workflows/setup_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -63,6 +63,23 @@ jobs:
. /core/venv/bin/activate || exit 2
neon-audio init-plugin -p coqui || exit 2
neon-speech init-plugin -p neon-stt-plugin-nemo || exit 2
pi_image_3_11:
runs-on: ubuntu-latest
timeout-minutes: 90
steps:
- uses: actions/checkout@v2
- name: Test chroot installation
uses: pguyot/arm-runner-action@v2
with:
optimize_image: false
base_image: https://2222.us/app/files/neon_images/pi/debian-base-image-rpi4_2023-07-12_16_30.img.xz
cpu: cortex-a53
copy_repository_path: /core
commands: |
bash /core/test/pi_setup_3_11.sh || exit 2
. /core/venv/bin/activate || exit 2
neon-audio init-plugin -p coqui || exit 2
neon-speech init-plugin -p neon-stt-plugin-nemo || exit 2
legacy-remote:
strategy:
matrix:
Expand Down
4 changes: 2 additions & 2 deletions .github/workflows/unit_tests.yml
Original file line number Diff line number Diff line change
Expand Up @@ -15,7 +15,7 @@ jobs:
util_tests:
strategy:
matrix:
python-version: [ 3.7, 3.8, 3.9, '3.10' ]
python-version: [ 3.7, 3.8, 3.9, '3.10', '3.11' ]
runs-on: ubuntu-latest
timeout-minutes: 15
steps:
Expand Down Expand Up @@ -58,7 +58,7 @@ jobs:
unit_tests:
strategy:
matrix:
python-version: [ 3.7, 3.8, 3.9, '3.10' ]
python-version: [ 3.7, 3.8, 3.9, '3.10', '3.11' ]
runs-on: ubuntu-latest
timeout-minutes: 15
steps:
Expand Down
5 changes: 3 additions & 2 deletions docker/.env
Original file line number Diff line number Diff line change
@@ -1,2 +1,3 @@
NEON_SKILLS_DIR=./skills/
NEON_XDG_PATH=./xdg
NEON_SKILLS_DIR=${PWD}/skills/
NEON_XDG_PATH=${PWD}/xdg
XDG_RUNTIME_DIR=/run/user/1000
4 changes: 2 additions & 2 deletions docker_overlay/root/run.sh
Original file line number Diff line number Diff line change
Expand Up @@ -28,6 +28,6 @@
# SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

# Python package installation must occur in a separate thread, before module load, for the entry point to be loaded.
neon install-default-skills
neon install-skill-requirements /skills
#neon install-default-skills
#neon install-skill-requirements /skills
neon run-skills
7 changes: 4 additions & 3 deletions neon_core/__init__.py
Original file line number Diff line number Diff line change
Expand Up @@ -26,16 +26,17 @@
# NEGLIGENCE OR OTHERWISE) ARISING IN ANY WAY OUT OF THE USE OF THIS
# SOFTWARE, EVEN IF ADVISED OF THE POSSIBILITY OF SUCH DAMAGE.

import sys
# import sys

from neon_core.config import setup_resolve_resource_file, get_core_version
from os.path import dirname


# TODO: Deprecate below
NEON_ROOT_PATH = dirname(__file__)
sys.path.append(NEON_ROOT_PATH)
# sys.path.append(NEON_ROOT_PATH)

CORE_VERSION_STR = get_core_version()
CORE_VERSION_STR = "" # get_core_version()
setup_resolve_resource_file()

__all__ = ['NEON_ROOT_PATH',
Expand Down
33 changes: 17 additions & 16 deletions neon_core/cli.py
Original file line number Diff line number Diff line change
Expand Up @@ -83,16 +83,16 @@ def install_default_skills():
click.echo("Default Skills Installed")


@neon_core_cli.command(help=
"Install skill requirements for a specified directory")
@click.argument("skill_dir")
def install_skill_requirements(skill_dir):
from neon_core.util.skill_utils import install_local_skills
try:
installed = install_local_skills(skill_dir)
click.echo(f"Installed {len(installed)} skills from {skill_dir}")
except ValueError as e:
click.echo(e)
# @neon_core_cli.command(help=
# "Install skill requirements for a specified directory")
# @click.argument("skill_dir")
# def install_skill_requirements(skill_dir):
# from neon_core.util.skill_utils import install_local_skills
# try:
# installed = install_local_skills(skill_dir)
# click.echo(f"Installed {len(installed)} skills from {skill_dir}")
# except ValueError as e:
# click.echo(e)


@neon_core_cli.command(help="Start Neon Skills module")
Expand All @@ -102,14 +102,15 @@ def run_skills(install_skills):
from neon_utils.configuration_utils import init_config_dir
init_config_dir()

from neon_core.util.skill_utils import install_local_skills
# from neon_core.util.skill_utils import install_local_skills
from neon_core.skills.__main__ import main
if install_skills:
click.echo(f"Handling installation of skills in: {install_skills}")
try:
install_local_skills(install_skills)
except ValueError as e:
click.echo(f"Skill Installation Failed: {e}")
click.echo(f"Local skill installation is deprecated. "
f"Add pip specs to config.")
# try:
# install_local_skills(install_skills)
# except ValueError as e:
# click.echo(f"Skill Installation Failed: {e}")
click.echo("Starting Skills Service")
main()
click.echo("Skills Service Shutdown")
40 changes: 27 additions & 13 deletions neon_core/config.py
Original file line number Diff line number Diff line change
Expand Up @@ -32,15 +32,19 @@ def get_core_version() -> str:
Get the core version string.
NOTE: `init_config` should be called before this method
"""
# from neon_core.configuration import Configuration
# Configuration.load_all_configs({"disable_remote_config": True})

# TODO: Remove by 2024
from ovos_utils.log import log_deprecation
log_deprecation("This method is deprecated; use Python built-in utilities "
"to find package versions", "23.12.1")
# patch version string to allow downstream to know where it is running
import mycroft.version
core_version_str = '.'.join(map(str,
mycroft.version.CORE_VERSION_TUPLE)) + \
"(NeonGecko)"
mycroft.version.CORE_VERSION_STR = core_version_str
try:
import mycroft.version
core_version_str = '.'.join(map(str,
mycroft.version.CORE_VERSION_TUPLE)) + \
"(NeonGecko)"
mycroft.version.CORE_VERSION_STR = core_version_str
except (ImportError, AttributeError):
return ""
return core_version_str


Expand All @@ -49,14 +53,24 @@ def setup_resolve_resource_file():
Override default resolve_resource_file to include resources in neon-core.
Priority: neon-utils, neon-core, ~/.local/share/neon, ~/.neon, mycroft-core
"""
from ovos_utils.log import log_deprecation
from neon_utils.file_utils import resolve_neon_resource_file
from mycroft.util.file_utils import resolve_resource_file
try:
from mycroft.util.file_utils import resolve_resource_file
except (ImportError, AttributeError):
resolve_resource_file = None

def patched_resolve_resource_file(res_name):
log_deprecation("This method is deprecated; use "
"`ovos_utils.file_utils.resolve_resource_file.",
"23.12.1")
resource = resolve_neon_resource_file(res_name) or \
resolve_resource_file(res_name)
resolve_resource_file(res_name)
return resource

import mycroft.util
mycroft.util.file_utils.resolve_resource_file = \
patched_resolve_resource_file
try:
import mycroft.util
mycroft.util.file_utils.resolve_resource_file = \
patched_resolve_resource_file
except (ImportError, AttributeError):
pass
7 changes: 4 additions & 3 deletions neon_core/configuration/mark_2/neon.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -89,9 +89,7 @@ skills:
# TODO: extra_directories here is the default, can it be removed?
extra_directories:
- /home/neon/.local/share/neon/skills
default_skills:
# TODO: Defaults are just patching skills not yet pip installable
- https://github.com/JarbasSkills/skill-icanhazdadjokes/tree/dev
default_skills: []
PHAL:
ovos-PHAL-plugin-balena-wifi:
enabled: false
Expand Down Expand Up @@ -169,3 +167,6 @@ system:
user:
- gui_websocket:host
- websocket:host
language:
detection_module: None
translation_module: libretranslate_plug
Original file line number Diff line number Diff line change
@@ -0,0 +1,3 @@
{
"app_view_timeout_mode": "pause"
}
Loading
Loading