[WIP] Blog about working with Time Series Data using FastAI.jl

blog/_posts/2022-09-08-FastAI-time-series.md

@@ -0,0 +1,83 @@
+---
+title: FastAI.jl Time Series Development
+author: Saksham
+layout: blog
+---
+
+[FastAI.jl](https://github.com/FluxML/FastAI.jl) is a Julia library inspired by [fastai](https://github.com/fastai/fastai), and its goal is to create state-of-the-art deep learning models easily. FastAI.jl simplifies training fast and accurate neural nets using modern best practices.
+
+Time-Series models constitute an integral part of any machine learning stack. This blog post will demonstrate how to start working with time-series data with FastAI.jl and the [FastTimeSeries](https://github.com/FluxML/FastAI.jl/tree/master/FastTimeSeries) submodule. The work presented here was done as part of [GSoC'22](https://summerofcode.withgoogle.com/programs/2022/projects/Q9GVFW33) under the mentorship of Brian Chen, Kyle Daruwalla, and Lorenz Ohly.
+
+
+## Loading the data in a container
+
+To start off, we'll load the [ECG5000](http://timeseriesclassification.com/description.php?Dataset=ECG5000) dataset.
+
+```julia
+julia> using FastAI, FastTimeSeries, Flux
+julia> data, blocks = load(datarecipes()["ecg5000"]);
+```
+
+Our easy to use interface allows to load an input time series along with it's label at any index using `getobs(data, index)`. It also allows us to check the total number of observations using `numobs(data)`.
+
+```julia
+julia> input, class = sample = getobs(data, 25)
+(Float32[-0.28834122 -2.2725453 … 1.722784 1.2959242], "1")
+julia> numobs(data)
+5000
+```
+
+## Tasks
+
+The library supports `TSClassificationSingle(blocks, data)` and `TSRegression(blocks, data)` tasks. These are for single label time-series classification and single label time-series regression.
+
+```julia
+julia> task = TSClassificationSingle(blocks, data);
+```
+
+
+## Data Preprocessing
+
+Although, we have loaded the data in a container which can be used later while creating a `DataLoader` and training, often we would like to perform transformations on it. We can encode a sample input using
+`encodesample(task, Phase(), sample)`
+
+```julia
+julia> input, class = sample = getobs(data, 25)
+(Float32[-0.28834122 -2.2725453 … 1.722784 1.2959242], "1")
+julia> encodesample(task, Training(), (input, class))
+(Float32[-0.28937635 -2.2807038 … 1.7289687 1.3005764], Bool[1, 0, 0, 0, 0])
+```
+
+## Models
+
+The library contains implementation of the following models.
+- RNNs
+```julia
+julia> backbone = FastTimeSeries.Models.StackedLSTM(1, 16, 10, 2);
+julia> model = FastAI.taskmodel(task, backbone);
+```
+
+- [InceptionTime](https://www.google.com/search?client=safari&rls=en&q=inceptiontime&ie=UTF-8&oe=UTF-8)
+```julia
+julia> model = FastTimeSeries.Models.InceptionTime(1, 5);
+```
+
+## Training
+
+We create a pair of training and validation data loaders using `taskdataloaders` . They take care of batching and loading the data in parallel in the background. With the addition of an optimizer and a loss function, we can create a `Learner` and start training.
+
+```julia
+julia> traindl, validdl = taskdataloaders(data, task, 16);
+julia> learner = Learner(model, tasklossfn(task); data=(traindl, validdl), optimizer=ADAM(), callbacks = [ToGPU(), Metrics(accuracy)]);
+julia> fitonecycle!(learner, 10, 0.033);
+```
+
+We can view the loss and accuracy on the training and validation data after the training is compelete.
+
+<p float="middle">
+  <img src="/assets/2022-09-08-FastAI-time-series/train_result.png" height="250">
+</p>
+
+## Conclusion
+
+We saw how we can work on time-series data using FastAI.jl.