Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

breaking: allow custom-metadata in granules dapa query #254

Merged
merged 48 commits into from
Jan 10, 2024
Merged
Changes from 1 commit
Commits
Show all changes
48 commits
Select commit Hold shift + click to select a range
b961d56
feat: allow docs and redoc pages
wphyojpl Oct 9, 2023
7360585
fix: custom open url
wphyojpl Oct 9, 2023
3df0702
fix: get docs page to work
wphyojpl Oct 9, 2023
07e179d
Merge branch 'develop' of github.com:unity-sds/unity-data-services in…
wphyojpl Oct 9, 2023
70ca1d9
feat: return openapi via endpoint
wphyojpl Oct 9, 2023
64165e3
chore: updating documentation
wphyojpl Oct 13, 2023
827157f
fix: wrong schema
wphyojpl Oct 13, 2023
bd8e2c8
fix: adding some documentation
wphyojpl Oct 17, 2023
2fce468
feat: cql parser
wphyojpl Oct 18, 2023
9eb8fbf
fix: start to convert json to text
wphyojpl Oct 19, 2023
5550488
chore: consolidate granules custom data query into a single class
wphyojpl Oct 24, 2023
dbbc6e9
fix: update cql for query
wphyojpl Nov 7, 2023
118e525
chore: merge from develop
wphyojpl Nov 9, 2023
4142ec4
fix: update custom metadata update
wphyojpl Nov 9, 2023
8809755
chore: prepping granules to es work
wphyojpl Nov 9, 2023
07d2b8c
feat: more prep work
wphyojpl Nov 13, 2023
a7d2dc5
fix: raw test to see if new code works so far
wphyojpl Nov 13, 2023
b91dfcb
fix: add checksum & sum to granule item transformer
wphyojpl Nov 14, 2023
69cd9b9
granules index is in stac form now
wphyojpl Nov 16, 2023
a65fe48
feat: store stac document in ES
wphyojpl Nov 16, 2023
a22b105
fix: allow partial cumulus to stac
wphyojpl Nov 16, 2023
b6ad8f7
feat: update terraform
wphyojpl Nov 16, 2023
4b9eb70
fix: no filter policy at this moment
wphyojpl Nov 16, 2023
9f26c70
fix: missing argument when calling a method
wphyojpl Nov 16, 2023
35c7194
fix: missing comma
wphyojpl Nov 16, 2023
4d297cc
fix: update retrieve custom metadata for stac mapping
wphyojpl Nov 17, 2023
87cd865
fix: need extra properties
wphyojpl Nov 17, 2023
b80c76d
feat: add pagination + using ES
wphyojpl Nov 22, 2023
96f72b4
fix: still fixing properties
wphyojpl Nov 27, 2023
724e6bf
fix: trying properties again
wphyojpl Nov 27, 2023
53bff61
fix: offset is not int anymore
wphyojpl Nov 27, 2023
ae9b0c5
fix: validated logic for pagination
wphyojpl Nov 27, 2023
2b32ac5
fix: typo
wphyojpl Nov 27, 2023
5f8aad1
fix: some tweaks
wphyojpl Nov 27, 2023
0dc9ce0
fix: need geometry as point
wphyojpl Nov 27, 2023
15753fc
chore: dummy commit
wphyojpl Nov 27, 2023
aa48858
chore: dummy commit
wphyojpl Nov 27, 2023
fea9ce6
fix: need snake case event time + not returning class
wphyojpl Nov 27, 2023
eea0efa
fix: some minor tweaks
wphyojpl Dec 1, 2023
d416c6f
fix: extra format
wphyojpl Dec 4, 2023
da6a46d
fix: testing queries with filter cql
wphyojpl Dec 4, 2023
4ba2669
fix: just normal query. not query by page
wphyojpl Dec 4, 2023
3ddcab5
chore: add test case on pagination
wphyojpl Dec 4, 2023
ba31579
fix: api gateway terraform
wphyojpl Jan 2, 2024
58f2a7b
chore: consolidate same config variable
wphyojpl Jan 2, 2024
224c936
fix: add open api endpoint without authorization
wphyojpl Jan 2, 2024
0a519ea
Merge branch 'develop' into dapa-custom-search
wphyojpl Jan 3, 2024
6fb9a69
Merge remote-tracking branch 'origin/develop' into dapa-custom-search
ngachung Jan 6, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Prev Previous commit
Next Next commit
fix: extra format
  • Loading branch information
wphyojpl committed Dec 4, 2023
commit d416c6f96e4f6a3ece72bab89a83e8aeff4b9737
Original file line number Diff line number Diff line change
@@ -22,11 +22,11 @@ class GranulesIndexMapping:
"properties": {
"provider": {"type": "keyword"},
"status": {"type": "keyword"},
"datetime": {"type": "date"},
"updated": {"type": "date"},
"start_datetime": {"type": "date"},
"end_datetime": {"type": "date"},
"created": {"type": "date"},
"datetime": {"type": "date", "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd'T'HH:mm:ssZ||yyyy-MM-dd'T'HH:mm:ss'Z'||yyyy-MM-dd'T'HH:mm:ss.SSSSSSZ||yyyy-MM-dd'T'HH:mm:ss.SSSSSS'Z'||yyyy-MM-dd||epoch_millis"},
"updated": {"type": "date", "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd'T'HH:mm:ssZ||yyyy-MM-dd'T'HH:mm:ss'Z'||yyyy-MM-dd'T'HH:mm:ss.SSSSSSZ||yyyy-MM-dd'T'HH:mm:ss.SSSSSS'Z'||yyyy-MM-dd||epoch_millis"},
"start_datetime": {"type": "date", "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd'T'HH:mm:ssZ||yyyy-MM-dd'T'HH:mm:ss'Z'||yyyy-MM-dd'T'HH:mm:ss.SSSSSSZ||yyyy-MM-dd'T'HH:mm:ss.SSSSSS'Z'||yyyy-MM-dd||epoch_millis"},
"end_datetime": {"type": "date", "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd'T'HH:mm:ssZ||yyyy-MM-dd'T'HH:mm:ss'Z'||yyyy-MM-dd'T'HH:mm:ss.SSSSSSZ||yyyy-MM-dd'T'HH:mm:ss.SSSSSS'Z'||yyyy-MM-dd||epoch_millis"},
"created": {"type": "date", "format": "yyyy-MM-dd HH:mm:ss||yyyy-MM-dd'T'HH:mm:ssZ||yyyy-MM-dd'T'HH:mm:ss'Z'||yyyy-MM-dd'T'HH:mm:ss.SSSSSSZ||yyyy-MM-dd'T'HH:mm:ss.SSSSSS'Z'||yyyy-MM-dd||epoch_millis"},
},
},
"assets": {
2 changes: 1 addition & 1 deletion tests/integration_tests/test_custom_metadata_end_to_end.py
Original file line number Diff line number Diff line change
@@ -416,7 +416,7 @@ def test_06_retrieve_granule(self):

def test_06_retrieve_granule_filter(self):
temp_collection_id = f'URN:NASA:UNITY:{self.tenant}:{self.tenant_venue}:{self.collection_name}___{self.collection_version}'
post_url = f'{self._url_prefix}/collections/{temp_collection_id}/items?filter_input=c_data3 = \'Bellman Ford\' AND end_datetime >= \'2016-03-31\''
post_url = f'{self._url_prefix}/collections/{temp_collection_id}/items?filter_input=c_data3 = \'Bellman Ford\' AND end_datetime >= \'2016-01-31 11:11:11\''
headers = {
'Authorization': f'Bearer {self.cognito_login.token}',
'Content-Type': 'application/json',