[SPARK-40356][INFRA][PS] Upgrade pandas to 1.4.4 (infra and docs)

### What changes were proposed in this pull request?
Upgrade pandas to 1.4.4 in infra and doc gen

### Why are the changes needed?
https://pandas.pydata.org/docs/whatsnew/v1.4.4.html

Especially, fix bugs which mentioned in #36353:
- Fixed regression in DataFrame.fillna() not working on a DataFrame with a MultiIndex (GH47649)
- Fixed regression in DataFrame.eval() creating a copy when updating inplace (GH47449)

### Does this PR introduce _any_ user-facing change?
No

### How was this patch tested?
CI passed

Closes #37810 from Yikun/pandas-1.4.4.

Authored-by: Yikun Jiang <[email protected]>
Signed-off-by: Hyukjin Kwon <[email protected]>

Author: Yikun

dev/infra/Dockerfile

@@ -32,7 +32,7 @@ RUN $APT_INSTALL software-properties-common git libxml2-dev pkg-config curl wget
 RUN update-alternatives --set java /usr/lib/jvm/java-8-openjdk-amd64/jre/bin/java
 
 RUN curl -sS https://bootstrap.pypa.io/get-pip.py | python3.9
-RUN python3.9 -m pip install numpy pyarrow 'pandas<=1.4.3' scipy unittest-xml-reporting plotly>=4.8 sklearn 'mlflow>=1.0' coverage matplotlib
+RUN python3.9 -m pip install numpy pyarrow 'pandas<=1.4.4' scipy unittest-xml-reporting plotly>=4.8 sklearn 'mlflow>=1.0' coverage matplotlib
 
 RUN add-apt-repository ppa:pypy/ppa
 RUN apt update
@@ -45,7 +45,7 @@ RUN mkdir -p /usr/local/pypy/pypy3.7 && \
     ln -sf /usr/local/pypy/pypy3.7/bin/pypy /usr/local/bin/pypy3
 
 RUN curl -sS https://bootstrap.pypa.io/get-pip.py | pypy3
-RUN pypy3 -m pip install numpy 'pandas<=1.4.3' scipy coverage matplotlib
+RUN pypy3 -m pip install numpy 'pandas<=1.4.4' scipy coverage matplotlib
 
 RUN $APT_INSTALL gnupg ca-certificates pandoc
 RUN echo 'deb https://cloud.r-project.org/bin/linux/ubuntu focal-cran40/' >> /etc/apt/sources.list

python/pyspark/pandas/supported_api_gen.py

@@ -98,7 +98,7 @@ def generate_supported_api(output_rst_file_path: str) -> None:
 
     Write supported APIs documentation.
     """
-    pandas_latest_version = "1.4.3"
+    pandas_latest_version = "1.4.4"
     if LooseVersion(pd.__version__) != LooseVersion(pandas_latest_version):
         msg = (
             "Warning: Latest version of pandas (%s) is required to generate the documentation; "