Skip to content
Projects
Groups
Snippets
Help
This project
Loading...
Sign in / Register
Toggle navigation
A
Amazon-Selection-Data
Overview
Overview
Details
Activity
Cycle Analytics
Repository
Repository
Files
Commits
Branches
Tags
Contributors
Graph
Compare
Charts
Issues
0
Issues
0
List
Board
Labels
Milestones
Merge Requests
0
Merge Requests
0
CI / CD
CI / CD
Pipelines
Jobs
Schedules
Charts
Wiki
Wiki
Snippets
Snippets
Members
Members
Collapse sidebar
Close sidebar
Activity
Graph
Charts
Create a new issue
Jobs
Commits
Issue Boards
Open sidebar
abel_cjy
Amazon-Selection-Data
Commits
72393bc8
Commit
72393bc8
authored
Mar 01, 2026
by
chenyuanjie
Browse files
Options
Browse Files
Download
Email Patches
Plain Diff
fix
parent
e97a3b65
Show whitespace changes
Inline
Side-by-side
Showing
2 changed files
with
6 additions
and
3 deletions
+6
-3
es_flow_asin.py
Pyspark_job/export_es/es_flow_asin.py
+2
-2
es_util.py
Pyspark_job/utils/es_util.py
+4
-1
No files found.
Pyspark_job/export_es/es_flow_asin.py
View file @
72393bc8
...
...
@@ -120,9 +120,9 @@ class EsStDetail(TemplatesMysql):
self
.
df_synchronize
=
self
.
df_synchronize
.
join
(
self
.
df_profit_rate
,
on
=
[
'asin'
,
'price'
],
how
=
'left'
)
.
withColumn
(
"img_type"
,
F
.
split
(
F
.
col
(
"img_type"
),
","
)
"img_type
_arr
"
,
F
.
split
(
F
.
col
(
"img_type"
),
","
)
)
.
withColumn
(
"img_type
"
,
F
.
expr
(
"transform(img_type
, x -> cast(x as int))"
)
"img_type
_arr"
,
F
.
expr
(
"transform(img_type_arr
, x -> cast(x as int))"
)
)
.
withColumn
(
'profit_key'
,
F
.
concat_ws
(
"_"
,
F
.
col
(
"asin"
),
F
.
col
(
"price"
))
)
.
cache
()
...
...
Pyspark_job/utils/es_util.py
View file @
72393bc8
...
...
@@ -228,7 +228,7 @@ class EsUtils(object):
"type"
:
"short"
},
"img_type"
:
{
"type"
:
"
integer
"
"type"
:
"
keyword
"
},
"activity_type"
:
{
"type"
:
"keyword"
...
...
@@ -486,6 +486,9 @@ class EsUtils(object):
"tracking_since_type"
:
{
"type"
:
"short"
},
"img_type_arr"
:
{
"type"
:
"integer"
},
"profit_key"
:
{
"type"
:
"keyword"
},
...
...
Write
Preview
Markdown
is supported
0%
Try again
or
attach a new file
Attach a file
Cancel
You are about to add
0
people
to the discussion. Proceed with caution.
Finish editing this message first!
Cancel
Please
register
or
sign in
to comment