AWS python lambda - fails to import oracledb

[ralphwillgoss]

I'm trying to get the new oracledb library working in a AWS python lambda, using python 3.9.

After following the basic installation procedure and deploying my lambda, I get the following error:
{
"errorMessage": "Unable to import module 'main': cannot import name 'base_impl' from partially initialized module 'oracledb' (most likely due to a circular import) (/var/task/oracledb/init.py)",
"errorType": "Runtime.ImportModuleError",
{snip}
}

I've installed the library as per the instructions and created a simple zip file lambda deployment.

My lambda directory structure looks like the following:

I'm using a simple entry point to test the import of the library, main.py looks like:

import oracledb

def lambda_handler(event, context):
    pass

This all works fine locally, is there something subtle I have missed?

[anthony-tuininga]

I don't know much about AWS lambda but the error you are getting is suggesting that the shared library (C extension) is not being loaded properly. My directory looks like this:

aq.py
base_impl.cpython-310-x86_64-linux-gnu.so
connection.py
connect_params.py
constants.py
constructors.py
cursor.py
dbobject.py
defaults.py
driver_mode.py
dsn.py
errors.py
exceptions.py
__init__.py
lob.py
pool_params.py
pool.py
py.typed
soda.py
subscr.py
thick_impl.cpython-310-x86_64-linux-gnu.so
thin_impl.cpython-310-x86_64-linux-gnu.so
utils.py
var.py
version.py

Take note of the 3 files with .so -- these are the ones that your installation doesn't seem to be able to find!

[ybindu]

Hi @github4es, did you manage to resolve your issue? 'python-oracledb thin mode cannot be used because the cryptography package is not installed'

I'm facing the same issue. Even though I got crypto packages in my root folder, I'm getting this error.

Could someone guide me to the solution

[anthony-tuininga]

That error occurs because the cryptography package cannot be imported. Try these commands in your main script:

from cryptography import x509
from cryptography.hazmat.primitives import hashes, serialization
from cryptography.hazmat.primitives.ciphers import algorithms, modes, Cipher
from cryptography.hazmat.primitives.asymmetric import padding
from cryptography.hazmat.primitives.kdf import pbkdf2

That should help determine the source of the problem.

[shivanibhavsar02]

Hi @anthony-tuininga , i am also facing same issue, the oracledb directory screenshot which you have put has 3 main files as you said, those are with .so extension . But when i installed oracledb in my local, it has those 3 files with .pyd extension. Is there any issue with that?

[anthony-tuininga]

The extension .so is used on Linux. On Windows the extension is .pyd. That isn't a problem.

[ralphwillgoss]

@shivanibhavsar02 as mentioned below, the .pyd extensions are Windows specific. If you try and install this packaged lambda with Windows binaries on an AWS, which is running Linux, you will get the import errors mentioned in this article.

[dharanispg]

Hello Guys, Same issue with AWS Glue as well , but I have confirmed that .so files existence in the zip. still it's failing
ImportError: cannot import name 'base_impl' from 'oracledb' (/tmp/modules.zip/oracledb/init.py)
Any reasons why ?

[ETzaf]

The files need to be directly on disk to be loaded. They cannot be zipped up.

Hello, i am facing the same issue. Can you be for specific to your answer please? Thank you

[peanutbutter97]

Set up an EC2 to install the lib then zipped out.

[Takahir-O]

The files need to be directly on disk to be loaded. They cannot be zipped up.

Hello, i am facing the same issue. Can you be for specific to your answer please? Thank you

Hello. I had the same situation and solved it in the following way. (I do not use EC2)
(1) I matched the local python version with the Lambda version.
The local python version is 3.10, but Lambda is python 3.9, so I set it to 3.9.

(2) I downloaded the Linux-compatible version to a directory by pip, as shown in this link
https://aws.amazon.com/jp/premiumsupport/knowledge-center/lambda-python-package-compatible/

Note that if your local python is 3.10, the module downloaded by this method will be the 3.10 version.

Finally, I added the downloaded folder to the Lambda layer.

Hope it works. Thank you.

[cjbj]

Thanks for sharing this info.

[antonizero99]

Thanks @Takahir-O . You saved my day.

[RabiaHasanZaheer]

I'm getting the same error in AWS Lambda and I've check library is correctly installed. Also installed cryptography just in case. I installed linux compatible version.

[ralphwillgoss]

how did you create the lambda zip deployment package?

[shivanibhavsar02]

@ralphwillgoss Hi, i am also facing same issue, i have installed all libraries correctly. i am running the code in my local in windows OS and in AWS lambda. At both places i am facing same issue. Can you help please?

[ralphwillgoss]

@shivanibhavsar02 you need to ensure that the system you are deploying from, matches the system you are deploying too
Windows -> Windows
Linux -> Linux

In your case, you cannot deploy from Windows -> AWS (Linux), as the Oracle binaries would have been packaged according to the the system deploying (Windows).

[tsalyers]

I had a very similar problem to this. At first it was because I downloaded the library on a Windows machine before I zipped it up, but it wasn't working even with a Linux version.

Then I tried downloading it with the binary-only flag (pip install --only-binary=:all: oracledb -t .) and that seems to have worked. I'm able to connect to Oracle from my test lambda function.

[ralphwillgoss]

thanks @tsalyers, glad this helped

[AjGitHubStore]

Hello Guys, Same issue with AWS Glue as well , but I have confirmed that .so files existence in the zip. still it's failing ImportError: cannot import name 'base_impl' from 'oracledb' (/tmp/modules.zip/oracledb/init.py) Any reasons why ?

Are you able to resolve an issue? I am facing the same issue. Glue version 4, Python version 3.10

[vignxs]

You can use additional python module option to install oracledb . This option is in job parameters

[AjGitHubStore]

That's not an option for me ... I am going with the zip file option.