Basic architecture

[dravog7]

Right now, there are 5 components

• Compile - compile the submitted code
• execute - execute the submitted code
• evaluate - evaluate the outputs and submitted code
• errors - a place to declare errors for compile and execute
• settings - to load and provide interface for settings
• sandbox- to hold different sandbox classes

Comment to discuss improvements and additions

[akhilmhdh]

If this exists the sole purpose of executing this would be enough

[dravog7]

Redesigned the architecture

• Program - Represent a program, provides method to execute in configured sandbox
• sandbox - a class inheriting the baseSandBox class and overriding compile and execute functions of sandbox
• settings - manage settings
• errors - define errors
• evaluate - contain Evaluation class which takes a program and input output pairs and execute code, as well as measure score based on given Metrics
• Metrics - classes inheriting baseMetric class that evaluate the expected output and received output and return a score.

architecture of Testing

• language tests - set of tests for each language as classes inheriting BaseTestSandBox
• base tests - define BaseTestSandBox and SecureTestSandBox (for security testing)
• test_sandbox - defines classes for each sandbox inheriting support language test classes and secureTestSandBox if security is supported by that sandbox.

[dravog7]

@ParadoxZero