Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dev to master #1596

Closed
wants to merge 195 commits into from
Closed
Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
195 commits
Select commit Hold shift + click to select a range
664d46e
Updated RHACS connector to support self signed certificate authentica…
lakshmi51974368 Nov 23, 2022
f05af82
Updated code to support query without millisecond in Paloalto/Cyberea…
thangaraj-ramesh Nov 25, 2022
4548f94
Merge branch 'develop' into release/5.0.x
Nov 29, 2022
40eb411
Removed language common fields (#984)
Dec 8, 2022
8ee6d54
Support for asynchronous API calls in transmission modules (#1038)
Jan 24, 2023
2f83d7a
Auth header serialize fix, response wraper fixes (#1298)
Jan 26, 2023
09fd538
Added aiohttp ssl certificate proper handling (#1308)
Jan 31, 2023
e2b6a18
Added cookie support (#1310)
Feb 1, 2023
226488a
resolve merge conflicts from develop
Feb 3, 2023
43ecec8
remove unnecessary variable definition
Feb 3, 2023
56e027b
Merge pull request #1315 from opencybersecurityalliance/5.0_dev_merge
Feb 3, 2023
3d00347
Paloalto - changes done to map process.x_unique_id with data source f…
thangaraj-ramesh Feb 8, 2023
cbef95b
Bump boto3 from 1.26.55 to 1.26.64 in /stix_shifter (#1317)
dependabot[bot] Feb 8, 2023
214e343
fix mapping error (#1320)
JingqiuDu Feb 9, 2023
5de5810
base release5.0.x - Cookies are handled for cybereason asynchronous c…
thangaraj-ramesh Feb 13, 2023
1603bd2
resolve merge conflict with requirements file
Feb 13, 2023
950359b
Bump boto3 from 1.26.64 to 1.26.74 in /stix_shifter (#1337)
dependabot[bot] Feb 21, 2023
af06312
Bump flask from 2.2.2 to 2.2.3 in /stix_shifter
dependabot[bot] Feb 21, 2023
155c93d
Merge pull request #1330 from opencybersecurityalliance/dependabot/pi…
Feb 24, 2023
bd7506b
Update OCSF network traffic mappings (#1332)
mdazam1942 Feb 24, 2023
3fb5ea4
Bump boto3 from 1.26.74 to 1.26.78 in /stix_shifter (#1344)
dependabot[bot] Feb 24, 2023
4e6408c
aiogoogle module used for async changes in gcp_chronicle (#1331)
thangaraj-ramesh Feb 24, 2023
e2bf8df
update mapping tables to show both comparision and observation AND OR…
Feb 28, 2023
c0eced9
upddate mapping for Reaqta (#1326)
JingqiuDu Feb 28, 2023
0721674
fixed merge conflicts with requirements file
Feb 28, 2023
9025116
Updating file hash mapping for Athena OCSF support (#1345)
mdazam1942 Mar 1, 2023
d6bf4b2
Build warnings fix (#1347)
Mar 1, 2023
71739d4
azure_log_analytics: fix translation of IN operator (#1355)
pcoccoli Mar 1, 2023
8a82d3f
support large query with elastic search_after pagination (#1299)
tingdai Mar 1, 2023
cd24c2d
Remove the x-ecs-process and x-ecs-file entities from elastic_ecs map…
cmadam Mar 2, 2023
7ceb131
QRadarEpochToTimestamp for exponential notation (#1352)
KaneBrennan132 Mar 2, 2023
8b7e00a
cybereason quick ping (#1350)
yurii-klymenko Mar 2, 2023
09fcd1d
Merge branch 'develop' into release/5.0.x
Mar 3, 2023
cd68c08
Removed json loads/dumps in aws
Mar 6, 2023
9333b30
Merge pull request #1361 from opencybersecurityalliance/rel-5.0-up-to…
mdazam1942 Mar 7, 2023
10d3c19
Okta connector (#1323)
thangaraj-ramesh Mar 7, 2023
2176e6d
Bump boto3 from 1.26.78 to 1.26.84 in /stix_shifter (#1363)
dependabot[bot] Mar 7, 2023
2315772
resolve merge conflict with requirements file
Mar 7, 2023
c60febd
Merge pull request #1367 from opencybersecurityalliance/release/5.0.x
mdazam1942 Mar 7, 2023
8fa2148
Bump aiomysql from 0.0.21 to 0.1.1 in /stix_shifter (#1369)
dependabot[bot] Mar 8, 2023
c603ca4
Bump aioboto3 from 10.4.0 to 11.0.1 in /stix_shifter (#1368)
dependabot[bot] Mar 8, 2023
b7bfa8f
Add Okta table of mappings and update elastic ECS (#1372)
Mar 8, 2023
c45d044
5.1.0 changelog (#1373)
Mar 8, 2023
e6b1c61
Async changes for Okta UDI connector (#1383)
SharmilaMS-Hcl Mar 14, 2023
47a1811
Fix #1375, optimize get_pagesize() function call, and add testcases …
tingdai Mar 15, 2023
8182d0d
Consolidate `network-traffic`, `user-account`, `file` objects in the …
Harmedox Mar 15, 2023
8fed1fa
GitHub action update (#1385)
mdazam1942 Mar 15, 2023
4b022cd
Bump aiohttp-retry from 2.4.0 to 2.8.3 in /stix_shifter (#1374)
dependabot[bot] Mar 15, 2023
3d89171
fix json loads of data arg in stix-shifter CLI (#1394)
mdazam1942 Mar 17, 2023
19cd85f
Await async fixes (#1391)
Mar 17, 2023
244ce47
get configs (#1392)
yurii-klymenko Mar 17, 2023
8795a37
Updated custom properties mapping in Okta with 'x_' prefix (#1387)
SharmilaMS-Hcl Mar 20, 2023
b2e8dc4
Splunk: Fix MAC address to display in proper STIX format (#1386)
thangaraj-ramesh Mar 20, 2023
3826d6d
Added metadata changes for GCP Chronicle (#1393)
SharmilaMS-Hcl Mar 20, 2023
8bab25a
Added process:x_unique_id property to Splunk (#1389)
thangaraj-ramesh Mar 20, 2023
ce729df
5.1.1 changelog (#1395)
Mar 21, 2023
0b5dff9
Elastic ecs module readme (#1400)
mdazam1942 Mar 27, 2023
21747b4
Pagination handled for azure_log_analytics (#1398)
thangaraj-ramesh Mar 28, 2023
559947b
Bump pyopenssl from 23.0.0 to 23.1.0 in /stix_shifter (#1401)
dependabot[bot] Mar 28, 2023
4b85c73
Add metadata CLI and documenations (#1396)
mdazam1942 Mar 29, 2023
f8c468a
Change QRadar domain name mapping (#1342)
KaneBrennan132 Mar 31, 2023
8b5b69c
hard coded base uri in microsoft graph security connector (#1406)
mdazam1942 Mar 31, 2023
c518015
Update README for IBM Verify Privilege Vault (Secret Server) connecto…
Deepshikha8514 Apr 3, 2023
8788d25
Fixed error handling for darktrace on raw html response (#1416)
Apr 3, 2023
cfadd42
Change config labels to sentence case (#1417)
omkar-g Apr 4, 2023
2216c7c
Fix for Athena error handling, error log printing in tranlsation (#1415)
Apr 5, 2023
39500a1
Added async to Azure sentinal (#1419)
Apr 6, 2023
56c4ccd
Fix: Graph API fails if used without lamda operators on collection ty…
mdazam1942 Apr 10, 2023
c35b515
Bump aioboto3 from 11.0.1 to 11.1.0 in /stix_shifter (#1411)
dependabot[bot] Apr 10, 2023
6d0ab87
Bump pyopenssl from 23.1.0 to 23.1.1 in /stix_shifter (#1405)
dependabot[bot] Apr 10, 2023
3e29f39
IBM Verify Privilege Vault api path changes (#1424)
Deepshikha8514 Apr 13, 2023
f36062c
Bump json-fix from 0.5.1 to 0.5.2 in /stix_shifter (#1426)
dependabot[bot] Apr 13, 2023
bc20d32
Cleaning up from requests lib (#1429)
Apr 18, 2023
8602293
MSATP async token, removed ADAL lib (#1428)
Apr 18, 2023
62457c2
Msatp with alerts refactor (#1404)
aviv1ron1 Apr 21, 2023
319c404
Okta Error Code Mapping Changes for develop Branch (#1434)
SharmilaMS-Hcl Apr 25, 2023
9107e78
Correct network-traffic mappings for elastic_ecs (#1430)
cmadam Apr 25, 2023
ca445e2
Documentation updates (#1435)
Apr 26, 2023
9f6160f
Update Reversinglabs connector (#1436)
SalmanMesia Apr 27, 2023
cb03034
Elastic-ecs mapping improvements for network traffic attributes (#1410)
Harmedox Apr 27, 2023
cdc8df7
fix url value property in azure mapping (#1444)
Apr 27, 2023
c699612
Bump flask from 2.2.3 to 2.3.1 in /stix_shifter (#1440)
dependabot[bot] Apr 28, 2023
0cb7105
update table of mappings for MS Graph, Elastic ECS, Microsoft Defende…
Apr 28, 2023
465505d
changelog release 5.2.0 notes (#1446)
Apr 28, 2023
004de86
set urllib3 library requirement (#1449)
May 1, 2023
672808b
changelog for 5.2.1 (#1452)
May 1, 2023
7c66d29
Bump flask from 2.3.1 to 2.3.2 in /stix_shifter (#1454)
dependabot[bot] May 2, 2023
bb280e2
Fix proxy create_results_connection method (#1463)
yurii-klymenko May 3, 2023
58a859d
enable observer data in transmit (#1453)
Harmedox May 3, 2023
d342862
Elastic-ecs: Patch observer mapping to `x-oca-asset` object (#1464)
Harmedox May 3, 2023
7101184
Add AbuseIPDB Connector (#1441)
SalmanMesia May 3, 2023
f9ae534
Elastic-ecs mapping: consolidate `x-ecs-container` attributes into th…
Harmedox May 4, 2023
0bf83cc
Added timeout for API client calls (#1459)
May 4, 2023
54ca62c
Adding new graph alert resource support in Graph security module (#1439)
mdazam1942 May 5, 2023
91d4af0
mapping fixes for Microsoft Graph Security (#1420)
May 5, 2023
a21eaa7
fix error_test transform_query (#1470)
yurii-klymenko May 8, 2023
27ac9f6
Alienvault OpenThreatExchange connector (#1442)
SalmanMesia May 9, 2023
bfb96b1
Update stix2.1 mapping files in azure sentinel module (#1472)
mdazam1942 May 9, 2023
72f889d
Elastic-ecs: update dialect attributes with `.keyword` (#1474)
Harmedox May 10, 2023
05e7dd7
to_stix_map validator (#1469)
pcoccoli May 10, 2023
0b67d44
Elastic-ecs: consolidate asset identifier (#1477)
Harmedox May 10, 2023
c8de075
QRadar - Remove Zero Values from IP and Mac Results (#1468)
KaneBrennan132 May 11, 2023
14b83a3
Updated Config changes for GCP Chronicle for develop branch (#1476)
SharmilaMS-Hcl May 12, 2023
6141486
Add Intezer connector (#1457)
SalmanMesia May 12, 2023
37c07ad
ThreatQ connector (#1461)
SalmanMesia May 12, 2023
4d40c7c
set alert options default value to false (#1481)
mdazam1942 May 12, 2023
303751d
Added urllib3 1.26.15 to connector requirements (#1482)
May 12, 2023
582148c
Virus total connector (#1458)
SalmanMesia May 12, 2023
1eca09b
Cisco Secure Malware Analytics (formerly Threat Grid) Connector (#1460)
SalmanMesia May 12, 2023
1817ecb
RecordedFuture connector (#1462)
SalmanMesia May 12, 2023
5fe1a46
DShield connector (#1443)
SalmanMesia May 12, 2023
b0c07e5
error_test 2queries (#1483)
yurii-klymenko May 15, 2023
d61a5a5
SDO connector cleanup and table of mappings (#1484)
May 15, 2023
e2398e4
changelog for 5.3.0 (#1485)
May 15, 2023
14b5ec0
timeout max -> 1 hour; result limit -> 10 million (#1487)
subbyte May 17, 2023
2494de6
Better error reporting for bad certificate (#1490)
yurii-klymenko May 18, 2023
4d14643
fix mapping references in elastic-ecs connector (#1471)
Harmedox May 26, 2023
c83ec9c
minor code cleanup (#1494)
subbyte May 26, 2023
76b4586
Add description to stix-bundle connector README (#1497)
May 29, 2023
163bf05
default translator support (#1491)
yurii-klymenko May 31, 2023
1d8ca73
ReaQta Use TTP Custom Object (#1473)
JingqiuDu May 31, 2023
6e3306a
remove SNI from authentication options (#1498)
May 31, 2023
dfb0715
Async support in Datadog connector (#1492)
mdazam1942 May 31, 2023
b93b098
Update CONTRIBUTING.md
claurau Jun 6, 2023
27bbb6c
x-oca-event.code switch from int to str (#1499)
aviv1ron1 Jun 7, 2023
ba13f1b
remove cybox false flag for observed-data properties (#1502)
Jun 7, 2023
b3ffb12
Remove cybox checks from map validator (#1504)
pcoccoli Jun 7, 2023
d9bbca6
elastic_ecs: fix email-addr:value mappings in 'from' maps (#1508)
pcoccoli Jun 13, 2023
fe2a692
Patch elastic mappings (#1501)
Harmedox Jun 14, 2023
e38bc1e
Error messaging update (#1503)
mdazam1942 Jun 14, 2023
a67253d
changelog for 5.3.1 (#1511)
Jun 15, 2023
f376d59
Adding to stix dialect feature (#1231)
mdazam1942 Jun 22, 2023
dc72086
Reaqta name change (#1514)
Jun 23, 2023
edf2a24
Update CLA link in CONTRIBUTING.md (#1517)
claurau Jun 26, 2023
3005df5
Azure log analytics mapping improvements (#1496)
thangaraj-ramesh Jun 26, 2023
9e3df37
Splunk UDI Connector -Upgrade (#1479)
thangaraj-ramesh Jun 26, 2023
7058817
LIKE operator only added for events queries (#1521)
KaneBrennan132 Jun 29, 2023
3609c17
to-STIX dialects documentation added (#1515)
mdazam1942 Jul 6, 2023
236e104
Remove ancient 'uuid==1.30' from requirements.txt (#1524)
pcoccoli Jul 7, 2023
c423e5c
ibm_security_verify: fixes (#1522)
pcoccoli Jul 7, 2023
eab6c5b
Move results processing to transmission results (#1519)
mdazam1942 Jul 10, 2023
60c24b2
Framework Changes for Handling Nested List of Dictionaries (#1516)
SharmilaMS-Hcl Jul 18, 2023
f78ef71
AWS GuardDuty UDI Connector (#1525)
SharmilaMS-Hcl Jul 19, 2023
051d6ad
6.0.0 changelog (#1531)
Jul 19, 2023
ab14e89
fix #1533 with type import update (#1534)
subbyte Jul 20, 2023
66ffa20
Update codecov.yml
Jul 21, 2023
519c2d0
Attrs dependency fix and connector cleanup (#1537)
Jul 21, 2023
3d3c69a
update 6.0 changelog (#1538)
Jul 21, 2023
666c307
To-STIX mapping keyword documentation (#1529)
mdazam1942 Jul 24, 2023
f069e1c
Setup fix for installing libraries from commit hash (#1539)
Jul 24, 2023
fc1952e
Update CHANGELOG.md for 6.0.1
Jul 24, 2023
a39432f
update stix2-validator library to 3.1.4 (#1542)
Jul 26, 2023
d1c45b7
map_validator: make sure 'object' name is a str (#1540)
pcoccoli Jul 26, 2023
f7b6f2a
changelog update for 6.0.2 (#1544)
Jul 26, 2023
3272270
Fix stix_bundle connector results translation (#1545)
mdazam1942 Jul 27, 2023
e26d13d
6.0.3 release notes (#1546)
Jul 27, 2023
e561247
Mapping Fixes for AWS GuardDuty (#1543)
SharmilaMS-Hcl Aug 1, 2023
216fbe1
Update STIX-shifter CLI Quick Lab.ipynb
Aug 2, 2023
8e4460b
Add docs folder (#1551)
Aug 3, 2023
8ea9417
Mysql connect timeout (#1552)
Aug 4, 2023
bcfa8c4
fix cursor call in mysql API client (#1550)
Aug 8, 2023
9236070
CLI lab updates and STIX validator removal (#1555)
Aug 9, 2023
2ca0017
Update connector coding lab (#1557)
mdazam1942 Aug 15, 2023
634f037
Fix variable assignment error with ECS event.start/end (#1556)
Technici4n Aug 15, 2023
1b2a342
cli lab instruction fixes (#1558)
Aug 15, 2023
b281e05
Add readthedocs configurations (#1547)
mdazam1942 Aug 15, 2023
a1340e7
Update CHANGELOG.md
Aug 15, 2023
5471b51
Update overview doc (#1561)
mdazam1942 Aug 15, 2023
0f94dfe
Lab landing page (#1563)
Aug 15, 2023
e47f908
add operator mapping example in CLI lab (#1564)
Aug 16, 2023
262303f
Fix ECS range queries with x-oca-event:start/end (#1559)
Technici4n Aug 17, 2023
9a2242a
Performance improvement of regex validation (#1565)
mdazam1942 Aug 21, 2023
729edfd
Vectra UDI connector (#1530)
thangaraj-ramesh Aug 23, 2023
199588c
Bump aioboto3 from 11.1.0 to 11.2.0 in /stix_shifter (#1562)
dependabot[bot] Aug 28, 2023
3caef2b
Update coding lab (#1566)
mdazam1942 Aug 28, 2023
6e5feb0
Bump flask from 2.3.2 to 2.3.3 in /stix_shifter (#1567)
dependabot[bot] Aug 31, 2023
3a03502
Fix: skip empty list and string in stix objects (#1568)
mdazam1942 Sep 1, 2023
6d2be30
Temporary fix for dialect not found map file (#1572)
Sep 5, 2023
0101b6a
Bump jsonmerge from 1.9.0 to 1.9.2 in /stix_shifter (#1570)
dependabot[bot] Sep 5, 2023
6387ed1
Fix readthedocs reference links (#1574)
mdazam1942 Sep 5, 2023
fe159c9
resolve case insensitive regex in elastic ECS connector #1569 (#1573)
subbyte Sep 6, 2023
c19bf28
Update CHANGELOG.md
Sep 7, 2023
20a829e
Add new screen shots to CLI Lab (#1576)
Sep 7, 2023
486c397
Fix and update coding lab (#1577)
mdazam1942 Sep 8, 2023
fe09cbb
Update requirements-lab.txt
Sep 11, 2023
df8dee5
fix coding lab (#1578)
mdazam1942 Sep 11, 2023
365011d
allow host address input in MS Graph configuration (#1582)
Sep 28, 2023
3db93af
Fixing authentication token handling (#1583)
mdazam1942 Sep 28, 2023
2726177
Bump aioboto3 from 11.2.0 to 11.3.0 in /stix_shifter (#1575)
dependabot[bot] Sep 29, 2023
7331a65
Update Azure Log Analytics stix transmission to use BaseJsonSyncConne…
mdazam1942 Sep 29, 2023
d4c29d6
include connector type in logger error (#1585)
Sep 29, 2023
6ed297a
Bump aiomysql from 0.1.1 to 0.2.0 in /stix_shifter (#1586)
dependabot[bot] Oct 3, 2023
7c03e98
set MS Graph default API to legacy alert endpoint (#1593)
Oct 3, 2023
8c176d4
6.2.2 CHANGELOG
Oct 3, 2023
53f8171
Merge branch 'main' into dev-to-master
Oct 5, 2023
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
The table of contents is too big for display.
Diff view
Diff view
  •  
  •  
  •  
41 changes: 41 additions & 0 deletions .github/workflows/code-coverage.yml
Original file line number Diff line number Diff line change
@@ -0,0 +1,41 @@
name: Code Coverage Analysis

on:
push:
branches:
- develop
pull_request:
branches:
- develop
types:
- opened
- edited
- reopened
- synchronize
- unlocked

jobs:
codecov:
runs-on: ubuntu-latest
steps:
- uses: actions/checkout@v3
- name: Set up Python
uses: actions/setup-python@v4
with:
python-version: '3.9'
- name: Install dependencies
run: |
python generate_requirements.py
pip install --upgrade pip setuptools wheel
pip install -r requirements-dev.txt
- name: Run test and generate coverage report
run: |
pip install pytest-cov
pip install codecov
pytest --cov=./ --cov-report=xml
- name: Upload coverage information to Codecov
uses: codecov/codecov-action@v3
with:
version: "v0.2.6"
fail_ci_if_error: true # optional (default = false)
verbose: true # optional (default = false)
19 changes: 7 additions & 12 deletions .github/workflows/main.yml
Original file line number Diff line number Diff line change
@@ -1,7 +1,7 @@
# This workflow will install Python dependencies, run tests and lint with a variety of Python versions
# For more information see: https://help.github.com/actions/language-and-framework-guides/using-python-with-github-actions

name: stix-shifter
name: CI Build

on: [push, pull_request]

Expand All @@ -14,11 +14,13 @@ jobs:
python-version: [3.8, 3.9]

steps:
- uses: actions/checkout@v2
- uses: actions/checkout@v3
- name: Set up Python ${{ matrix.python-version }}
uses: actions/setup-python@v2
uses: actions/setup-python@v4
with:
python-version: ${{ matrix.python-version }}
cache: 'pip'
cache-dependency-path: '**/requirements-dev.txt'
- name: Install dependencies
run: |
python generate_requirements.py
Expand All @@ -31,14 +33,7 @@ jobs:
flake8 . --count --select=E901,E999,F821,F822,F823 --show-source --statistics
# exit-zero treats all errors as warnings. The GitHub editor is 127 chars wide
flake8 . --count --exit-zero --max-complexity=10 --max-line-length=127 --statistics
- name: Run test and generate coverage report
- name: Run unittest
run: |
pip install pytest
pip install pytest-cov
pip install codecov
pytest --cov=./ --cov-report=xml
- name: Upload coverage information to Codecov
uses: codecov/codecov-action@v1
with:
fail_ci_if_error: true # optional (default = false)
verbose: true # optional (default = false)
pytest -vv
2 changes: 1 addition & 1 deletion .gitignore
Original file line number Diff line number Diff line change
Expand Up @@ -59,7 +59,7 @@ coverage.xml

# virtualenv
.venv
venv/
venv*/
ENV/
virtualenv*/
labenv/
Expand Down
32 changes: 32 additions & 0 deletions .readthedocs.yaml
Original file line number Diff line number Diff line change
@@ -0,0 +1,32 @@
# .readthedocs.yaml
# Read the Docs configuration file
# See https://docs.readthedocs.io/en/stable/config-file/v2.html for details

# Required
version: 2

# Set the OS, Python version and other tools you might need
build:
os: ubuntu-22.04
tools:
python: "3.11"
# You can also specify other tool versions:
# nodejs: "19"
# rust: "1.64"
# golang: "1.19"

# Build documentation in the "docs/" directory with Sphinx
sphinx:
configuration: docs/conf.py

# Optionally build your docs in additional formats such as PDF and ePub
formats:
- pdf
# - epub

# Optional but recommended, declare the Python requirements required
# to build your documentation
# See https://docs.readthedocs.io/en/stable/guides/reproducible-builds.html
python:
install:
- requirements: docs/requirements.txt
367 changes: 334 additions & 33 deletions CHANGELOG.md

Large diffs are not rendered by default.

209 changes: 0 additions & 209 deletions adapter-guide/connectors/azure_log_analytics_supported_stix.md

This file was deleted.

Loading