AD25C01 Exploratory Data Analysis – Semester III – AI&DS – R-2025

Subject Code & Name: AD25C01 – Exploratory Data Analysis

Regulation: R-2025

Semester: III (Third Semester)

Branch: B.Tech. Artificial Intelligence and Data Science (AI&DS)

Credits / L-T-P: 4 Credits | L-T-P: 3-0-2

Course Objectives

• This course aims to provide in-depth knowledge and practical skills in performing Exploratory Data Analysis (EDA), using statistical and graphical techniques.

Full Unit-wise Syllabus

Unit I – Introduction

Purpose and goals of EDA – Mindset for effective data exploration – Significance of EDA in the data science lifecycle – Types of data and quality issues – EDA vs. Classical and Bayesian approaches – Tools and libraries for EDA – Visual techniques for initial insights.

Practical: Load a real-world dataset (CSV/JSON) into a Pandas DataFrame and inspect its structure using .head(), .info(), .shape, and .describe(); Choose one dataset and create a "data story" using 3 to 5 visualizations that highlight trends, patterns, or anomalies

Unit II – Data Wrangling

Importing, loading, and cleaning datasets – Merging, reshaping, and pivoting data – Handling missing values and outliers – Renaming, deduplication, discretization, and binning – Permutation and random sampling – Challenges in real-world data preprocessing.

Practical: Load a messy dataset with missing values, duplicates, and incorrect data types. Identify and handle missing values using Pandas functions, applying mean or median for numeric data and mode for categorical data. Remove duplicates and verify data consistency; Rename ambiguous column names to meaningful ones and convert improperly inferred data types to suitable formats (e.g., object to float). Apply binning (equal-width/equal-frequency) on a continuous column such as age or income. Display the new binned column and analyze its utility

Unit III – Multivariate Analysis, Relationship Exploration and Causal Inference

Univariate, Bivariate, and Multivariate Analysis – Interpreting relationships and Simpson's Paradox – Multicollinearity and correlation pitfalls – Visualizing multivariate data using pair plots and heatmaps – Causal inference in data science: correlation vs. causation, confounding variables.

Practical: Create and analyze a detailed correlation matrix. Identify and explain variable pairs with high correlation coefficients (r > 0.8 or r < –0.8); Construct a sns.pairplot() for 4–6 numerical columns with an additional categorical hue to observe grouped patterns across variables

Unit IV – Time-Oriented Data Exploration

Time-series data – Time-based indexing and date time conversion in pandas – Seasonal patterns, resampling (up/down), and aggregations – Line plots, rolling statistics, and anomaly spotting.

Practical: Perform both down-sampling (e.g., daily to monthly) and up-sampling (conceptual/fill methods) using resample() and aggregate meaningful summaries; Compute rolling mean and standard deviation for a chosen variable (e.g., 7-day moving average). Use plots to identify anomalies or trend shifts

Unit V – Statistical Testing for Insights

Hypothesis Testing: Null vs. Alternative, Type I & II Errors – Statistical tests: t-tests, p-values using scipy and statsmodels – Interpreting test results in the context of EDA.

Practical: Perform t-tests or other appropriate statistical tests using scipy.stats. Record t-values, p-values, and significance level conclusions; Interpret test results in layman terms: Report whether the difference is statistically significant, and what it implies for decision-making

Unit VI – From EDA to Model Deployment

Supervised vs. unsupervised models – Simple and Multiple Linear Regression – Train/Test Split, Cross-validation – Evaluation metrics: MAE, RMSE, R², Accuracy, F1-score – Saving models using pickle or joblib – Basic deployment using Flask for local predictions.

Practical: Load a dataset and select suitable independent and dependent variables for simple linear regression. Split the dataset into training and testing sets. Train a linear regression model using sklearn, evaluate it with MAE, RMSE, and R². Interpret the model's performance; Save the trained model using pickle or joblib. Build a minimal Flask application with a /predict route that takes input and returns a prediction. Test locally

Course Outcomes (COs)

• CO1: Describe the importance of exploratory data analysis in understanding and summarizing datasets.
• CO2: Analyze datasets identify patterns, trends, anomalies, and relationships among variables.
• CO3: Evaluate data quality and extract meaningful insights for decision-making.
• CO4: Design effective exploratory data analysis workflows for real-world datasets.
• CO5: Recognize the importance of continuous learning by adapting to emerging tools and evolving data-driven practices.

Assessment Pattern (Quick Note)

• Weightage: Continuous Assessment 50% | End Semester Examinations 50%
• Internal methodology: Activities 10% (Assignments 30, Quiz 10, Virtual demonstration 25, Flipped Classroom 10, Review of GATE & IES questions 25), Internal Theory Examinations 30%, Internal Laboratory Examination 10%

Source: Official Anna University – B.Tech. Artificial Intelligence and Data Science R-2025 Syllabus
Last Updated: September 2026