Add direct support for OpenAI o1 updates (e.g. developer messages)

[willbakst]

Description

OpenAI recently released o1 with new things such as developer messages. We should add support for this.

[koxudaxi]

Investigation Results for OpenAI o1 Support

Current Status

• The o1 model (specifically o1-2024-12-17) is currently only accessible to Tier 5 users
• Attempted direct testing was not possible due to access restrictions:

Error 404: The model `o1-2024-12-17` does not exist or you do not have access to it

Key Findings

Developer Messages

• developer role is a replacement for the traditional system role in o1 models
• OpenAI automatically converts system to developer messages
• No explicit conversion needed on our end for backward compatibility

Implementation Recommendations

1. Message Role Handling

   • No immediate action required for system/developer role conversion
   • OpenAI handles this conversion automatically

2. Function Calling

   • Documentation suggests support is available, but requires verification
   • Unable to verify actual behavior due to access restrictions

References

• OpenAI o1 Documentation
• Text Generation Guide for developer role
• O1 and New Tools Announcement

[willbakst]

Ok I think we can close this then given the automatic support. We can always revisit this down the line if we need to add developer messages, which I would assume would operate exactly like our existing system message support