Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
Amazon-Selection-Data
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
abel_cjy
Amazon-Selection-Data
Commits
f11c3848
Commit
f11c3848
authored
Feb 11, 2026
by
chenyuanjie
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
流量选品-30day-增加榜单asin流程
parent
d86f1009
Expand all
Hide whitespace changes
Inline
Side-by-side
Showing
4 changed files
with
5 additions
and
1 deletions
+5
-1
kafka_flow_asin_detail_test.py
Pyspark_job/my_kafka/kafka_flow_asin_detail_test.py
+0
-0
kafka_rank_asin_detail.py
Pyspark_job/my_kafka/kafka_rank_asin_detail.py
+0
-0
es_util.py
Pyspark_job/utils/es_util.py
+0
-0
templates.py
Pyspark_job/utils/templates.py
+5
-1
No files found.
Pyspark_job/my_kafka/kafka_flow_asin_detail_test.py
0 → 100644
View file @
f11c3848
This diff is collapsed.
Click to expand it.
Pyspark_job/my_kafka/kafka_rank_asin_detail.py
0 → 100644
View file @
f11c3848
This diff is collapsed.
Click to expand it.
Pyspark_job/utils/es_util.py
View file @
f11c3848
This diff is collapsed.
Click to expand it.
Pyspark_job/utils/templates.py
View file @
f11c3848
...
@@ -603,11 +603,15 @@ class Templates(object):
...
@@ -603,11 +603,15 @@ class Templates(object):
def
modify_kafka_state
(
self
):
def
modify_kafka_state
(
self
):
# 正式的实时消费才修改状态
# 正式的实时消费才修改状态
script_name
=
sys
.
argv
[
0
]
.
split
(
"/"
)[
-
1
]
.
split
(
"."
)[
0
]
script_name
=
sys
.
argv
[
0
]
.
split
(
"/"
)[
-
1
]
.
split
(
"."
)[
0
]
if
self
.
consumer_type
==
'latest'
and
self
.
test_flag
==
'normal'
and
script_name
in
[
'kafka_flow_asin_detail'
,
'kafka_asin_detail'
]:
if
self
.
consumer_type
==
'latest'
and
self
.
test_flag
==
'normal'
and
script_name
in
[
'kafka_flow_asin_detail'
,
'kafka_asin_detail'
,
'kafka_rank_asin_detail'
]:
if
script_name
==
'kafka_flow_asin_detail'
:
if
script_name
==
'kafka_flow_asin_detail'
:
kafka_field
=
'kafka_flow_state'
kafka_field
=
'kafka_flow_state'
wx_users
=
[
'chenyuanjie'
,
'pengyanbing'
]
wx_users
=
[
'chenyuanjie'
,
'pengyanbing'
]
wx_msg
=
f
"站点: {self.site_name} 日期类型: {self.date_type} {self.date_info} asin详情实时消费数据到es准备工作已完成,可以开启详情爬取!"
wx_msg
=
f
"站点: {self.site_name} 日期类型: {self.date_type} {self.date_info} asin详情实时消费数据到es准备工作已完成,可以开启详情爬取!"
elif
script_name
==
'kafka_rank_asin_detail'
:
kafka_field
=
'kafka_flow_state'
wx_users
=
[
'chenyuanjie'
,
'pengyanbing'
]
wx_msg
=
f
"站点: {self.site_name} 日期类型:{self.date_type}, {self.date_info} 榜单asin详情实时消费数据到es准备工作已完成,可以开启详情爬取!"
elif
script_name
==
'kafka_asin_detail'
:
elif
script_name
==
'kafka_asin_detail'
:
kafka_field
=
'kafka_state'
kafka_field
=
'kafka_state'
wx_users
=
[
'fangxingjun'
,
'pengyanbing'
]
wx_users
=
[
'fangxingjun'
,
'pengyanbing'
]
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment