Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Generate a dashboard for ompparser's current capability #43

Open
chunhualiao opened this issue Jun 11, 2019 · 5 comments
Open

Generate a dashboard for ompparser's current capability #43

chunhualiao opened this issue Jun 11, 2019 · 5 comments
Assignees

Comments

@chunhualiao
Copy link
Contributor

chunhualiao commented Jun 11, 2019

Pick two sets of test files

Test the standalone ompparser to generate a wiki table of this repo, similar to:
https://github.com/LLNL/dataracebench/wiki/Summary-report-Apr-2019

, with columns indicating file names and pass/fail info.

Make the process automated.

@ouankou
Copy link
Contributor

ouankou commented Jun 19, 2019

The initial testing result for the official OpenMP examples is generated.
https://github.com/passlab/ompparser/blob/b05d2ee9ff1280bc37d20bbdcb8bcd5ac12380df/docs/openmp_examples_results.md

They are marked as PASS be default and will be checked manually later.

@ouankou
Copy link
Contributor

ouankou commented Jun 19, 2019

The initial result for DataRaceBench examples is generated.
https://github.com/passlab/ompparser/blob/b05d2ee9ff1280bc37d20bbdcb8bcd5ac12380df/docs/dataracebench_results.md

Some of the results are recognized as FAILED correctly.

@chunhualiao
Copy link
Contributor Author

@ouankou Please calculate the percentage of pass for two benchmarks. Manual calculation is fine (with help of grep of key words).

@yanyh15
Copy link
Member

yanyh15 commented Aug 20, 2019

Anjia's work: test_folder.sh script is now used to extract OpenMP constructs from C examples and then invoke ompparser to parse and unparse. To validate, user needs to manually compare the ompparser output with the construct in the original C code. Ideally, a script to auto-validate would be useful.

@yanyh15 yanyh15 removed the high priority high priority label Sep 23, 2019
XinyaoYI added a commit that referenced this issue Sep 29, 2019
Removed the redundant rules in the lexer
XinyaoYI added a commit that referenced this issue Oct 1, 2019
1. Removed the redundant rules in the lexer.
2. Restruct the function addOpenMPClause.
@chunhualiao
Copy link
Contributor Author

chunhualiao commented Nov 9, 2019

LLVM has a testing method to embed expected results into input source files and to automate compare compiler generated vs. expected results:
https://llvm.org/docs/TestingGuide.html

FileCheck - Flexible pattern matching file verifier

https://llvm.org/docs/CommandGuide/FileCheck.html

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants