Update to v0.9.6

hackingmaterials · Mar 8, 2021 · f23e8a1 · f23e8a1
1 parent 54790cf
commit f23e8a1
Show file tree

Hide file tree

Showing 150 changed files with 13,570 additions and 14,321 deletions.
diff --git a/atomate/__init__.py b/atomate/__init__.py
@@ -1 +1 @@
-__version__ = "0.9.5"
+__version__ = "0.9.6"
diff --git a/docs/_sources/advanced_stores.rst.txt b/docs/_sources/advanced_stores.rst.txt
@@ -0,0 +1,79 @@
+
+.. title:: Advanced Storage Stratagies
+.. _advanced_storage:
+
+==================
+Advanced Storage Stratagies
+==================
+
+Storing data greater than 16 Mb 
+============
+
+Introduction
+------------
+
+As the analysis capabilities of the high-throughput computational material science grows, more and more data is required to perform the analysis.
+While the atomic structure and metadata about the calculations can be stored within the 16 Mb limit of MongoDB's data framework the storage requirement for field data like the charge density is often orders of magnitude larger than that limit.
+As such, alternative methods are required to handle the storage of specific fields in the parsed task document.
+For these fields, with larger storage requirements, the data itself will be removed from the task document and replaced with and ``fs_id`` to reference where the data is stored.
+This results in a task document with a much smaller size, which will still be uploaded onto the MongoDB specified in your ``DB_FILE``
+
+Two approaches are currently available in atomate to handle the storage of large data chunk.
+The user can implement a GridFS-based chunking and storage procedure as we have done in ``VaspCalcDb``.
+But the recommended method for large object storage is to use ``maggma`` stores implemented in the ``CalcDb`` class.
+Currently, only the Amazon S3 store is implemented.
+
+Please read the documentation for ``maggma`` for more details _maggma: https://materialsproject.github.io/maggma
+
+Configuration
+------------
+
+To storing the larger items to an AWS S3 bucket via the ``maggma`` API, the user needs to have the ``maggma_store`` keyword in present in the ``db.json`` file used by atomate.
+
+.. code-block:: json
+
+    {
+        "host": "<<HOSTNAME>>",
+        "port": <<PORT>>,
+        "database": "<<DB_NAME>>",
+        "collection": "tasks",
+        "admin_user": "<<ADMIN_USERNAME>>",
+        "admin_password": "<<ADMIN_PASSWORD>>",
+        "readonly_user": "<<READ_ONLY_PASSWORD>>",
+        "readonly_password": "<<READ_ONLY_PASSWORD>>",
+        "aliases": {}
+        "maggma_store": {
+                "bucket" : "<<BUCKET_NAME>>",
+                "s3_profile" : "<<S3_PROFILE_NAME>>",
+                "compress" : true,
+                "endpoint_url" : "<<S3_URL>>"
+        }
+    }
+
+Where ``<<BUCKET_NAME>>`` is S3 bucket where the data will be stored, ``<<S3_PROFILE_NAME>>`` is the name of the S3 profile from the ``$HOME/.aws`` folder.
+Note, this AWS profile needs to be available anywhere the ``VaspCalcDb.insert_task`` is called (i.e. on the computing resource where the database upload of the tasks takes place).
+
+Usage
+-----------
+
+Example: store the charge density 
+
+To parse a completed calculation directory.  We need to instantiate the ``drone`` with the ``parse_aeccar`` or ``parse_chgcar`` flag.
+
+.. code-block:: python
+
+    calc_dir = "<<DIR>>/launcher_2019-09-03-11-46-20-683785"
+    drone = VaspDrone(parse_chgcar=True, parse_aeccar=True)
+    doc = drone.assimilate(calc_dir)
+    task_id = mmdb.insert_task(doc)
+
+Some workflows like the ``StaticWF`` will pass the parsing flags like ``parse_chgcar`` to the drone directly.
+
+To access the data using the task_id we can call
+
+.. code-block:: python
+    
+    chgcar = mmdb.get_chgcar(task_id)
+
+Similar functionalities exist for the band structure and DOS.
+Please refer to the documentation of ``VaspCalcDb`` for more details.
diff --git a/docs/_sources/atomate.common.firetasks.rst.txt b/docs/_sources/atomate.common.firetasks.rst.txt
@@ -5,6 +5,7 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.common.firetasks.tests
 
@@ -35,7 +36,6 @@ atomate.common.firetasks.run\_calc module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.common.firetasks.tests.rst.txt b/docs/_sources/atomate.common.firetasks.tests.rst.txt
@@ -20,7 +20,6 @@ atomate.common.firetasks.tests.test\_parse\_outputs module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.common.rst.txt b/docs/_sources/atomate.common.rst.txt
@@ -5,8 +5,21 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.common.firetasks
+   atomate.common.tests
+
+Submodules
+----------
+
+atomate.common.powerups module
+------------------------------
+
+.. automodule:: atomate.common.powerups
+   :members:
+   :undoc-members:
+   :show-inheritance:
 
 Module contents
 ---------------

diff --git a/docs/_sources/atomate.common.tests.rst.txt b/docs/_sources/atomate.common.tests.rst.txt
@@ -0,0 +1,21 @@
+atomate.common.tests package
+============================
+
+Submodules
+----------
+
+atomate.common.tests.test\_powerups module
+------------------------------------------
+
+.. automodule:: atomate.common.tests.test_powerups
+   :members:
+   :undoc-members:
+   :show-inheritance:
+
+Module contents
+---------------
+
+.. automodule:: atomate.common.tests
+   :members:
+   :undoc-members:
+   :show-inheritance:
diff --git a/docs/_sources/atomate.feff.firetasks.rst.txt b/docs/_sources/atomate.feff.firetasks.rst.txt
@@ -5,6 +5,7 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.feff.firetasks.tests
 
@@ -43,7 +44,6 @@ atomate.feff.firetasks.write\_inputs module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.feff.firetasks.tests.rst.txt b/docs/_sources/atomate.feff.firetasks.tests.rst.txt
@@ -12,7 +12,6 @@ atomate.feff.firetasks.tests.test\_tasks module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.feff.fireworks.rst.txt b/docs/_sources/atomate.feff.fireworks.rst.txt
@@ -5,6 +5,7 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.feff.fireworks.tests
 
@@ -19,7 +20,6 @@ atomate.feff.fireworks.core module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.feff.fireworks.tests.rst.txt b/docs/_sources/atomate.feff.fireworks.tests.rst.txt
@@ -12,7 +12,6 @@ atomate.feff.fireworks.tests.test\_fireworks module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.feff.rst.txt b/docs/_sources/atomate.feff.rst.txt
@@ -5,6 +5,7 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.feff.firetasks
    atomate.feff.fireworks
@@ -21,7 +22,6 @@ atomate.feff.database module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.feff.workflows.rst.txt b/docs/_sources/atomate.feff.workflows.rst.txt
@@ -5,6 +5,7 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.feff.workflows.tests
 
@@ -27,7 +28,6 @@ atomate.feff.workflows.presets module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.feff.workflows.tests.rst.txt b/docs/_sources/atomate.feff.workflows.tests.rst.txt
@@ -28,7 +28,6 @@ atomate.feff.workflows.tests.test\_xas\_workflows module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.lammps.firetasks.rst.txt b/docs/_sources/atomate.lammps.firetasks.rst.txt
@@ -36,7 +36,6 @@ atomate.lammps.firetasks.write\_inputs module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.lammps.fireworks.rst.txt b/docs/_sources/atomate.lammps.fireworks.rst.txt
@@ -12,7 +12,6 @@ atomate.lammps.fireworks.core module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.lammps.rst.txt b/docs/_sources/atomate.lammps.rst.txt
@@ -5,6 +5,7 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.lammps.firetasks
    atomate.lammps.fireworks
@@ -37,7 +38,6 @@ atomate.lammps.utils module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.lammps.workflows.rst.txt b/docs/_sources/atomate.lammps.workflows.rst.txt
@@ -12,7 +12,6 @@ atomate.lammps.workflows.core module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.qchem.firetasks.rst.txt b/docs/_sources/atomate.qchem.firetasks.rst.txt
@@ -5,12 +5,21 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.qchem.firetasks.tests
 
 Submodules
 ----------
 
+atomate.qchem.firetasks.critic2 module
+--------------------------------------
+
+.. automodule:: atomate.qchem.firetasks.critic2
+   :members:
+   :undoc-members:
+   :show-inheritance:
+
 atomate.qchem.firetasks.fragmenter module
 -----------------------------------------
 
@@ -51,7 +60,6 @@ atomate.qchem.firetasks.write\_inputs module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.qchem.firetasks.tests.rst.txt b/docs/_sources/atomate.qchem.firetasks.tests.rst.txt
@@ -4,6 +4,14 @@ atomate.qchem.firetasks.tests package
 Submodules
 ----------
 
+atomate.qchem.firetasks.tests.test\_critic2 module
+--------------------------------------------------
+
+.. automodule:: atomate.qchem.firetasks.tests.test_critic2
+   :members:
+   :undoc-members:
+   :show-inheritance:
+
 atomate.qchem.firetasks.tests.test\_fragmenter module
 -----------------------------------------------------
 
@@ -36,7 +44,6 @@ atomate.qchem.firetasks.tests.test\_write\_inputs module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.qchem.fireworks.rst.txt b/docs/_sources/atomate.qchem.fireworks.rst.txt
@@ -12,7 +12,6 @@ atomate.qchem.fireworks.core module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.qchem.rst.txt b/docs/_sources/atomate.qchem.rst.txt
@@ -5,6 +5,7 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.qchem.firetasks
    atomate.qchem.fireworks
@@ -37,7 +38,6 @@ atomate.qchem.powerups module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.qchem.workflows.base.rst.txt b/docs/_sources/atomate.qchem.workflows.base.rst.txt
@@ -4,6 +4,14 @@ atomate.qchem.workflows.base package
 Submodules
 ----------
 
+atomate.qchem.workflows.base.FF\_and\_critic module
+---------------------------------------------------
+
+.. automodule:: atomate.qchem.workflows.base.FF_and_critic
+   :members:
+   :undoc-members:
+   :show-inheritance:
+
 atomate.qchem.workflows.base.double\_FF\_opt module
 ---------------------------------------------------
 
@@ -28,7 +36,6 @@ atomate.qchem.workflows.base.torsion\_potential module
    :undoc-members:
    :show-inheritance:
 
-
 Module contents
 ---------------
 

diff --git a/docs/_sources/atomate.qchem.workflows.rst.txt b/docs/_sources/atomate.qchem.workflows.rst.txt
@@ -5,6 +5,7 @@ Subpackages
 -----------
 
 .. toctree::
+   :maxdepth: 4
 
    atomate.qchem.workflows.base
    atomate.qchem.workflows.tests
-Original file line number
+Diff line change
@@ Expand Up / @@ -20,7 +20,6 @@ atomate.common.firetasks.tests.test\_parse\_outputs module @@
        :undoc-members:
        :show-inheritance:
     Module contents
     ---------------
@@ Expand Down @@