Skip to main content

Advanced Data Analysis 2018 Workshop

Advanced Data Analysis 2018 Workshop

Provincial Ministerial Exams

Overall learning goal

By engaging in the outlined activities during the data analysis workshops, participants will:

  • establish a common portrait of the provincial ministerial exam results,

  • produce a summary report of the ministerial exam results to share with the english community.

  • provide a report on the additional data requested by DEEN

  • provide feedback to DEEN on the current status of data reporting

  • consider potential explanations and questions for further analysis.

Synopsis

Once again this year, participants come together to establish a common portrait and understanding of the provincial ministerial exam results for the sanctioned subjects in Quebec’s English sector. The arising report details the global success rates and final average marks for each subject. The uniform subjects are:

  • Francais Langue Seconde (Base & Enrichi)

  • English Language Arts

  • Mathematics (CST, T&S, Science)

  • Science and Technology (General & Applied)

Using a collaborative inquiry approach, team members representing each of the nine English School Boards of Quebec participate in the one day workshop each fall, to analyse and report the ministerial results from June of that year. The resulting report is submitted to and published by DEEN. The day also give members an opportunity to discuss the current processes and consider the most effective ways of analysing results and reporting them to DEEN and other relevant audiences.

Instructional design

INTRODUCTION

The facilitator welcomes members to the EBP offices and introduces the day by reminding members that this joint reporting between CARE & EBP is a tradition dating back five years. For the first time, data from all school boards is in and ready to report.

All members have access to the new 2018 reporting template. This template was created to help the process of reporting the data and providing the provincial portrait but members can improve it, and this should be part of today’s discussions.

Members are reminded that we are working together to develop a common language across all school boards. The overall objective is to look at the provincial picture first of all, and then dig deeper into item analysis and student samples.

This year, DEEN has requested reporting on additional data, which will be discussed today.

DEVELOPMENT
PART 1: BRAINSTORMING

The day starts with a brainstorm session on what the needs are from the report for each school board, considering how its used and how it can be made more useful. This includes a discussion about what the current challenges are. Brainstorming takes place in small groups and forms part of discussions for the day.

PART 2: DATA REPORTING

The group are set up in pairs/small groups by subject for the data analysis and given part of the morning to add the new results to the template.

Data analysis is done in two phases.

  1. Descriptive reporting of big 4 data only (Math, Science & Technology, English and French). Lack of History data should be indicated in results. This should be followed by DEEN requirements. The facilitator reminds participants that judgement should be suspended.

  2. Members should note down potential explanations, thoughts and possible questions for further analysis. T-chart model can be used, with factual data (results) on one side and ideas on the other.

PART 3: DATA ANALYSIS

Following input of the new data into the reporting template, members discuss their experience and thoughts for consideration beyond the current picture.

A tour de table allows each group to report back on their findings from analysing and reporting the new data.

PART 4: TRANSFER - ACTION PLAN

Issues about processes and communication for data entry are discussed as a whole group. Together, based on the discussion, members create the DBMS Data Entry Status Document June 2018 for submission to DEEN, along with the provincial report.

 

The CARE and EBP teams will work together to finalise reports, send them to DEEN, and post them on the EBP website.

The DEEN representative will relay everything discussed today to DEEN for consideration.

Two CARE members have agreed to meet to draft procedures to offer more clarity about reporting ahead of the next meeting.

CONCLUSIONS

The Data Coach’s Guide To Improving Learning for All will support the work to be done at the next session. The chapter on defining student learning problems and digging into the data are worthwhile reading in advance of the session.

The facilitator thanks the members for attending and for their valuable contributions and the EBP team for their support.