Make milvus-lite a optional dependency

[SuperSecureHuman]

Right now, milvus lite is a required dependency. When trying to use it under docker, milvus-lite alone uses ~150MB.

This space is mostly unwanted if we dont use local DB (using localdb is unlikely in docker deployments)

[sre-ci-robot]

[APPROVALNOTIFIER] This PR is NOT APPROVED

This pull-request has been approved by: SuperSecureHuman
To complete the pull request process, please assign longjiquan after the PR has been reviewed.
You can assign the PR to them by writing /assign @longjiquan in a comment when ready.

The full list of commands accepted by this bot can be found here.

Needs approval from an approver in each of these files:

• OWNERS

Approvers can indicate their approval by writing /approve in a comment
Approvers can cancel approval by writing /approve cancel in a comment

[sre-ci-robot]

Welcome @SuperSecureHuman! It looks like this is your first PR to milvus-io/pymilvus 🎉

[XuanYang-cn]

@SuperSecureHuman Usually a system can run Milvus cluster or Milvus standalone is able to host ~200MB of PyMilvus, cuz 200MB is nothing comparing to Milvus. Also, if resources are limited, Milvus-lite is the best choice.

So why are you using Milvus but concerning PyMilvus disk usage? Also mounting volumes might be a solution to use milvus-lite inside a docker.

[SuperSecureHuman]

It's when using pymilvus connect to an existing cluster..

The node does not run milvus, rather connects to milvus.

Edit: This will help to speedup image builds, and reduce image sizes, helping with deployment times (especially when the application is on autoscaling)

[XuanYang-cn]

@SuperSecureHuman Hi, THX for the reply. We want milvus-lite to be part of PyMilvus by default so I labelled this PR wontfix. In this case I suggest you to clone pymilvus repo and use your own build of it if you insist, it's quiet easy for python:

1. fork and remove the milvus-lite requirement
2. git clone your pymilvus repo in docker
3. just run pip install -e . or make install at the project root

OR, a even simpler choice:

1. fork and remove the milvus-lite requirement in your own repo
2. install from remote resource with this command: pip install git+ssh://github.com/{YOUR-REPO}/pymilvus.git@master

[XuanYang-cn]

BTW you could try this in your Dockerfile: pip install git+ssh://github.com/SuperSecureHuman/pymilvus.git@master

[SuperSecureHuman]

Hi,

So the current workaround that I am doing is, installing pymilvus without deps, and installing the needed deps manually.. In our case, this alone gives us the required result (and ~20% reduction in image size)

You may close the issue if needed, this can be a suggested way if someone wants to setup their minimal docker images.

[XuanYang-cn]

Thanks for the contribution anyway!