如何更新基于其他列的PySpark中的列？

Question

我有一个数据框有“CUSTOMER_MAILID”，“OFFER_NAME”，“OFFER_ISAPPLIED”列。

样本数据：

+--------------------+--------------------+---------------+ 
|  CUSTOMER_MAILID|   OFFER_NAME|OFFER_ISAPPLIED| 
+--------------------+--------------------+---------------+ 
|pushpendrakaushik...|Jaipur Pink Panth...|    N| 
|pushpendrakaushik...|Jaipur Pink Panth...|    N| 
|dr.kshitijmathur@...|     |    N| 
|spdadhichassociat...|     |    N| 
|vinod.gogia@herom...|Jaipur Pink Panth...|    N| 
|prerak0401@gmail.com|     |    N| 
| garhwalsp@gmail.com|     |    N| 
|muditsharma1985@g...|     |    N| 
| amit1185@gmail.com|Jaipur Pink Panth...|    N| 

我想用 “Y” 更新 “OFFER_ISAPPLIED” 列值，如果 “OFFER_NAME” 列有一定价值的，除空。

我该如何实现它？

输出应该是这样的：

+--------------------+--------------------+---------------+ 
|  CUSTOMER_MAILID|   OFFER_NAME|OFFER_ISAPPLIED| 
+--------------------+--------------------+---------------+ 
|pushpendrakaushik...|Jaipur Pink Panth...|    Y| 
|pushpendrakaushik...|Jaipur Pink Panth...|    Y| 
|dr.kshitijmathur@...|     |    N| 
|spdadhichassociat...|     |    N| 
|vinod.gogia@herom...|Jaipur Pink Panth...|    Y| 
|prerak0401@gmail.com|     |    N| 
| garhwalsp@gmail.com|     |    N| 
|muditsharma1985@g...|     |    N| 
| amit1185@gmail.com|Jaipur Pink Panth...|    Y| 

Answer 1

用途：

from pyspark.sql.functions import * 

df.withColum("OFFER_ISAPPLIED", 
    when(col("OFFER_NAME").isNull(), "N").otherwise("Y"))