输入

实际产量

预期输出

df = df.withColumn("arr", F.split(F.col("Name"), " "))
    
df = (df.withColumn('FirstName', F.arr.getItem(0))
        .withColumn('MiddleName', F.arr.getItem(1))
        .withColumn('LastName', F.arr.getItem(2)))

问题在于中间名，因为我的代码不正确

解决方案

您的代码中只考虑了 3 个部分的情况，而显然还有其他您没有处理的情况。您可以根据 aName可以拥有的部分数量实现以下逻辑：

name_schema = StructType([
    StructField("first_name", StringType(), True),
    StructField("middle_name", StringType(), True),
    StructField("last_name", StringType(), True)
])

@F.udf(returnType=name_schema)
def split_name(name):
    parts = name.split()
    if len(parts) == 1:
        return (parts[0], "", "")
    elif len(parts) == 2:
        return (parts[0], "", parts[1])
    elif len(parts) == 3:
        return (parts[0], parts[1], parts[2])
    else:
        return (parts[0], " ".join(parts[1:-1]), parts[-1])

# Apply the UDF to split names
df = df.withColumn("split_name", split_name("Name"))

df = df.withColumn("first_name", F.col("split_name.first_name")) \
       .withColumn("middle_name", F.col("split_name.middle_name")) \
       .withColumn("last_name", F.col("split_name.last_name")) \
       .drop("split_name")

输出：

+-------------------------------------+----------+-----------------+-----------+
|Name                                 |first_name|middle_name      |last_name  |
+-------------------------------------+----------+-----------------+-----------+
|Anubhav Sharma                       |Anubhav   |                 |Sharma     |
|Rakesh Kumar Sharma                  |Rakesh    |Kumar            |Sharma     |
|Muthiah Srinivas attapatu Murlidharan|Muthiah   |Srinivas attapatu|Murlidharan|
+-------------------------------------+----------+-----------------+-----------+