Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
Amazon-Selection-Data
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
abel_cjy
Amazon-Selection-Data
Commits
76fd21ab
Commit
76fd21ab
authored
Jul 16, 2026
by
hejiangming
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
no message
parent
0bf384dc
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
16 additions
and
0 deletions
+16
-0
dwt_bs_top100.py
Pyspark_job/sqoop_export/dwt_bs_top100.py
+8
-0
dwt_bs_top100_change_rate.py
Pyspark_job/sqoop_export/dwt_bs_top100_change_rate.py
+8
-0
No files found.
Pyspark_job/sqoop_export/dwt_bs_top100.py
View file @
76fd21ab
...
@@ -25,6 +25,14 @@ if __name__ == '__main__':
...
@@ -25,6 +25,14 @@ if __name__ == '__main__':
test_flag
=
CommonUtil
.
get_sys_arg
(
len
(
sys
.
argv
)
-
1
,
None
)
test_flag
=
CommonUtil
.
get_sys_arg
(
len
(
sys
.
argv
)
-
1
,
None
)
print
(
f
"执行参数为{sys.argv}"
)
print
(
f
"执行参数为{sys.argv}"
)
# ============================================================
# 数据有效范围守卫:品类调研仅 us + month + 从 2025-07 起(到最新月)。
# ============================================================
if
not
(
site_name
==
'us'
and
date_type
==
'month'
and
tuple
(
map
(
int
,
str
(
date_info
)
.
split
(
'-'
)))
>=
(
2025
,
7
)):
print
(
f
"[SKIP] 参数不在有效范围(仅 us/month/date_info>=2025-07):site={site_name} type={date_type} date={date_info},跳过导出"
)
sys
.
exit
(
0
)
# 品类调研只有月粒度
# 品类调研只有月粒度
assert
date_type
==
DateTypes
.
month
.
name
,
f
"仅支持 month, 传入 date_type={date_type}"
assert
date_type
==
DateTypes
.
month
.
name
,
f
"仅支持 month, 传入 date_type={date_type}"
...
...
Pyspark_job/sqoop_export/dwt_bs_top100_change_rate.py
View file @
76fd21ab
...
@@ -25,6 +25,14 @@ if __name__ == '__main__':
...
@@ -25,6 +25,14 @@ if __name__ == '__main__':
test_flag
=
CommonUtil
.
get_sys_arg
(
len
(
sys
.
argv
)
-
1
,
None
)
test_flag
=
CommonUtil
.
get_sys_arg
(
len
(
sys
.
argv
)
-
1
,
None
)
print
(
f
"执行参数为{sys.argv}"
)
print
(
f
"执行参数为{sys.argv}"
)
# ============================================================
# 数据有效范围守卫:品类调研仅 us + month + 从 2025-07 起(到最新月)。
# ============================================================
if
not
(
site_name
==
'us'
and
date_type
==
'month'
and
tuple
(
map
(
int
,
str
(
date_info
)
.
split
(
'-'
)))
>=
(
2025
,
7
)):
print
(
f
"[SKIP] 参数不在有效范围(仅 us/month/date_info>=2025-07):site={site_name} type={date_type} date={date_info},跳过导出"
)
sys
.
exit
(
0
)
# 品类调研只有月粒度
# 品类调研只有月粒度
assert
date_type
==
DateTypes
.
month
.
name
,
f
"仅支持 month, 传入 date_type={date_type}"
assert
date_type
==
DateTypes
.
month
.
name
,
f
"仅支持 month, 传入 date_type={date_type}"
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment