The use of sensor-based measures of rumination time as a parameter for early disease detection has received a lot of attention in scientific research. This study aimed to assess the accuracy of health alerts triggered by a sensor-based accelerometer system within 2 different management strategies on a commercial dairy farm. Multiparous Holstein cows were enrolled during the dry-off period and randomly allocated to conventional (CON) or sensor-based (SEN) management groups at calving. All cows were monitored for disorders for a minimum of 10 DIM following standardized operating procedures (SOP). The CON group (n = 199) followed an established monitoring protocol on the farm. The health alerts of this group were not available during the study but were later included in the analysis. The SEN group (n = 197) was only investigated when the sensor system triggered a health alert, and a more intensive monitoring approach was implemented according to the SOP. To analyze the efficiency of the health alerts in detecting disorders, the sensitivity (SE) and specificity (SP) of health alerts were determined for the CON group. In addition, all cows were divided into 3 subgroups based on their health status and the status of the health alerts in order to retrospectively compare the course of rumination time. Most health alerts (87%, n = 217) occurred on DIM 1. For the confirmation of diagnoses, health alerts showed SE and SP levels of 71% and 47% for CON cows. In SEN cows, SE of 71% and 75% and SP of 48% and 43% were found for the detection of ketosis and hypocalcemia, respectively. The rumination time of the subgroups was affected by DIM and the interaction between DIM and the status of health alert and health condition.