Evaluation

[sergiomrebelo]

Conduct evaluation experiments with Module 1 to satisfy the two major challenges of it: exploration and automation.

In automation tests, we evaluate the capability of the system only on the automation of the preprocessing of contents given by users. On the other hand, in exploration tests, we also evaluate the system value of creating innovative designs and aims in the designers' exploratory processes.

Automation testing

Automation testing will consist of conducting the following tasks:

• Select some quotes (e.g. 10, each one with multiple images) in several languages (pt/es/en) and preprocess them.
• Run task 1 multiple times (e.g. 10) and observe if the outputs are the same.

Exploratory testing

Exploratory testing will consist of conducting the following tasks:

• Select some quotes (e.g. 10, each one with multiple images) in several languages (pt/es/en) and preprocess them
• Run task 1 multiple times (e.g. 10).
• Analyse the recognized emotions and line division are similar (line division is slightly influenced by a stochastic feature). #13

[JJ]

Can you please clarify a bit more?
Also, remember what I said about user journeys and user stories in #3

[sergiomrebelo]

Based on the developed user stories I realise that system has two main challenges: exploration and automation. I think that creative tasks could be evaluated based on these challenges.

I update the first comment of the milestone based on the proposal of evaluation that I have been working on.