We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
datetime
date
0.41.0
3.9
Mapping (stream maps, flattening, etc.)
Linux
In my Meltano configuration, I use meltano-map-transformer (latest version with [email protected]) with config as below:
stream_maps: xxx: creation: datetime.datetime.strptime(creation, '%Y-%m-%dT%H:%M:%S.%f%z') ...
With new update from singer-sdk v0.41, this field (creation) is mapped with date type in schema message.
creation
class CustomStreamMap(StreamMap): def _eval_type( # noqa: PLR0911 self, expr: str, default: th.JSONTypeHelper | None = None, ) -> th.JSONTypeHelper: ... if expr.startswith("datetime.date") or expr.endswith(".date()"): return th.DateType() if expr.startswith("datetime.datetime"): return th.DateTimeType() ....
I think we need to swap the position of 2 if clause to check the datetime data type firstly.
if
Related PR: #2665
class CustomStreamMap(StreamMap): def _eval_type( # noqa: PLR0911 self, expr: str, default: th.JSONTypeHelper | None = None, ) -> th.JSONTypeHelper: ... if expr.startswith("datetime.date") or expr.endswith(".date()"): return th.DateType()
if expr.startswith("datetime.datetime"): return th.DateTimeType() ....
No response
The text was updated successfully, but these errors were encountered:
That makes sense @lngvietthang. PRs welcome!
Sorry, something went wrong.
datetime.datetime
date-time
edgarrmondragon
Successfully merging a pull request may close this issue.
Singer SDK Version
0.41.0
Is this a regression?
Python Version
3.9
Bug scope
Mapping (stream maps, flattening, etc.)
Operating System
Linux
Description
In my Meltano configuration, I use meltano-map-transformer (latest version with [email protected]) with config as below:
With new update from singer-sdk v0.41, this field (
creation
) is mapped withdate
type in schema message.I think we need to swap the position of 2
if
clause to check thedatetime
data type firstly.Related PR:
#2665
Code
class CustomStreamMap(StreamMap):
def _eval_type( # noqa: PLR0911
self,
expr: str,
default: th.JSONTypeHelper | None = None,
) -> th.JSONTypeHelper:
...
if expr.startswith("datetime.date") or expr.endswith(".date()"):
return th.DateType()
Link to Slack/Linen
No response
The text was updated successfully, but these errors were encountered: