fix: Support pandas ExtensionArray ordering

[flying-sheep]

Fixes #6452

[codecov]

Codecov Report

Attention: Patch coverage is 92.30769% with 2 lines in your changes missing coverage. Please review.

Project coverage is 88.76%. Comparing base (b9243ba) to head (a2cb75f).

Files with missing lines	Patch %	Lines
holoviews/element/util.py	87.50%	2 Missing ⚠️

Additional details and impacted files

@@            Coverage Diff             @@
##             main    #6481      +/-   ##
==========================================
- Coverage   88.76%   88.76%   -0.01%     
==========================================
  Files         323      323              
  Lines       68681    68698      +17     
==========================================
+ Hits        60963    60978      +15     
- Misses       7718     7720       +2     

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.