metadata

title: Mip Csv Analyser
emoji: 🚀
colorFrom: yellow
colorTo: gray
sdk: streamlit
sdk_version: 1.28.1
app_file: app.py
pinned: false

Batch Run Analyzer

A comprehensive Streamlit application for analyzing batch run results from CSV or XLSX files, visualizing pass/fail statistics, and comparing runs across different environments.

Features

Support for both CSV and XLSX file formats
Multiple analysis modes:
- Multi: Analyze multiple files from different environments
- Compare: Compare two files to identify differences in scenario outcomes
- Weekly: Generate weekly trend reports
- Multi-Env Compare: Compare scenarios across multiple environments
Detailed statistics on passing and failing scenarios
Visual charts for failure counts by functional area
Interactive filtering by functional area and status
Time spent analysis per functional area
Error Message analysis

Setup and Installation

Clone this repository:

git clone <repository-url>
cd batch-run-csv-analyser

Install the required dependencies:
```
pip install -r requirements.txt
```
Run the application:
```
streamlit run app.py
```

File Format Support

CSV Format (Legacy)

The application still supports the original CSV format with the following columns:

Functional area
Scenario Name
Start datetime
End datetime
Status
Error Message

XLSX Format (New)

The application now supports XLSX files with step-level data:

Feature Name
Scenario Name
Step
Result
Time Stamp
Duration (ms)
Error Message

The application will automatically detect the file format based on the file extension and process it accordingly.

Usage

Start the application with streamlit run app.py
Use the sidebar to select the desired analysis mode
Upload the necessary files based on the selected mode
Follow the on-screen instructions for filtering and analysis

Analysis Modes

Multi Mode

Upload files from multiple environments for individual analysis. View statistics, filter by functional area, and see charts of failing scenarios.

Compare Mode

Upload two files to compare scenario statuses between them. The application will identify:

Consistent failures (failed in both files)
New failures (passed in the older file, failed in the newer)
New passes (failed in the older file, passed in the newer)

Weekly Mode

Upload files from multiple dates to see trend reports. Filter by environment and functional area, and view detailed statistics for each day.

Multi-Env Compare Mode

Compare scenarios across multiple environments to identify inconsistencies in test coverage.

Notes

Filename format is important for date extraction in Weekly mode. The application will try to extract dates using various patterns like name_YYYYMMDD_HHMMSS, name_YYYYMMDD, or any 8-digit sequence resembling a date.
For XLSX files, all steps within a scenario are aggregated to determine the overall scenario status.

Troubleshooting

If you encounter issues:

Ensure the file format follows the expected structure
Check the logs for specific error messages
Try processing smaller files first to verify functionality