Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
Amazon-Selection-Data
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
abel_cjy
Amazon-Selection-Data
Commits
7f300391
Commit
7f300391
authored
Mar 05, 2026
by
fangxingjun
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
no message
parent
814141c3
Hide whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
2 deletions
+3
-2
ods_self_asin_detail.py
Pyspark_job/sqoop_import/ods_self_asin_detail.py
+3
-2
No files found.
Pyspark_job/sqoop_import/ods_self_asin_detail.py
View file @
7f300391
...
@@ -13,9 +13,9 @@ if __name__ == '__main__':
...
@@ -13,9 +13,9 @@ if __name__ == '__main__':
assert
site_name
is
not
None
,
"site_name 不能为空!"
assert
site_name
is
not
None
,
"site_name 不能为空!"
assert
date_type
is
not
None
,
"date_type 不能为空!"
assert
date_type
is
not
None
,
"date_type 不能为空!"
assert
date_info
is
not
None
,
"date_info 不能为空!"
assert
date_info
is
not
None
,
"date_info 不能为空!"
year
=
date_info
.
split
(
"-"
)[
0
]
db_type
=
'postgresql_15'
db_type
=
'postgresql_15'
import_table
=
f
"{site_name}_self_asin_detail_{
2025
}"
import_table
=
f
"{site_name}_self_asin_detail_{
year
}"
hive_table
=
"ods_self_asin_detail"
hive_table
=
"ods_self_asin_detail"
partition_dict
=
{
partition_dict
=
{
...
@@ -103,6 +103,7 @@ if __name__ == '__main__':
...
@@ -103,6 +103,7 @@ if __name__ == '__main__':
REPLACE(REPLACE(REPLACE(variat_list, E'
\n
',' '), E'
\r
',' '), E'
\t
',' ') AS variat_list,
REPLACE(REPLACE(REPLACE(variat_list, E'
\n
',' '), E'
\r
',' '), E'
\t
',' ') AS variat_list,
REPLACE(REPLACE(REPLACE(bundle_asin_component_json, E'
\n
',' '), E'
\r
',' '), E'
\t
',' ') AS bundle_asin_component_json,
REPLACE(REPLACE(REPLACE(bundle_asin_component_json, E'
\n
',' '), E'
\r
',' '), E'
\t
',' ') AS bundle_asin_component_json,
REPLACE(REPLACE(REPLACE(cart_type, E'
\n
',' '), E'
\r
',' '), E'
\t
',' ') AS cart_type
REPLACE(REPLACE(REPLACE(cart_type, E'
\n
',' '), E'
\r
',' '), E'
\t
',' ') AS cart_type
REPLACE(REPLACE(REPLACE(site, E'
\n
',' '), E'
\r
',' '), E'
\t
',' ') AS site
FROM {import_table}
FROM {import_table}
WHERE date_info='{date_info}' AND
\
$CONDITIONS
WHERE date_info='{date_info}' AND
\
$CONDITIONS
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment