Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
Amazon-Selection-Data
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
abel_cjy
Amazon-Selection-Data
Commits
b4de6063
Commit
b4de6063
authored
Jul 22, 2026
by
chenyuanjie
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix
parent
77add939
Show whitespace changes
Inline
Side-by-side
Showing
1 changed file
with
3 additions
and
3 deletions
+3
-3
dws_flow_asin_month_refresh.py
Pyspark_job/doris_handle/dws_flow_asin_month_refresh.py
+3
-3
No files found.
Pyspark_job/doris_handle/dws_flow_asin_month_refresh.py
View file @
b4de6063
...
...
@@ -8,7 +8,7 @@ description: 流量选品月物化表刷新脚本——批量刷新近 3 月 sel
1) MySQL workflow_everyday.MAX(report_date) WHERE date_type='month' AND page='流量选品' → 取最大月份
2) 从最大月份向前推 3 月(含当月)→ 得到 3 个 date_info
3) 站点列表(SITES)枚举 × 近 3 月,循环执行 INSERT OVERWRITE
4) INSERT OVERWRITE SQL 复用 dwt_flow_asin_month.build_insert_overwrite_sql
4) INSERT OVERWRITE SQL 复用 dwt_flow_asin_month.build_
month_
insert_overwrite_sql
【无入参】
不接收 sys.argv,所有逻辑动态推断;海豚定时调度直接执行 spark-submit 即可
执行示例:
...
...
@@ -26,7 +26,7 @@ from utils.db_util import DBUtil
from
doris_handle.dwt_flow_asin_month
import
(
_exec_doris_sql
,
build_insert_overwrite_sql
,
build_
month_
insert_overwrite_sql
,
)
...
...
@@ -68,7 +68,7 @@ def refresh_one_month(site_name, date_info):
print
(
f
"
\n
========== 刷新 site={site_name}, date_info={date_info}, table=selection.{selection_table} =========="
)
print
(
f
"[执行] Doris INSERT OVERWRITE selection.{selection_table}"
)
_exec_doris_sql
([
build_insert_overwrite_sql
(
site_name
,
selection_table
,
date_info
)])
_exec_doris_sql
([
build_
month_
insert_overwrite_sql
(
site_name
,
selection_table
,
date_info
)])
print
(
f
"[完成] selection.{selection_table} 刷新成功"
)
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment