Elsevier

Journal of Biomechanics

Volume 46, Issue 13, 3 September 2013, Pages 2320-2325
Journal of Biomechanics

Short communication
Functional limits of agreement applied as a novel method comparison tool for accuracy and precision of inertial measurement unit derived displacement of the distal limb in horses

https://doi.org/10.1016/j.jbiomech.2013.06.004Get rights and content

Abstract

Over ground motion analysis in horses is limited by a small number of strides and restraints of the indoor gait laboratory. Inertial measurement units (IMUs) are transforming the knowledge of human motion and objective clinical assessment through the opportunity to obtain clinically relevant data under various conditions. When using IMUs on the limbs of horses to determine local position estimates, conditions with high dynamic range of both accelerations and rotational velocities prove particularly challenging. Here we apply traditional method agreement and suggest a novel method of functional data analysis to compare motion capture with IMUs placed over the fetlock joint in seven horses. We demonstrate acceptable accuracy and precision at less than or equal to 5% of the range of motion for detection of distal limb mounted cranio-caudal and vertical position. We do not recommend the use of the latero-medial position estimate of the distal metacarpus/metatarsus during walk where the average error is 10% and the maximum error 111% of the range. We also show that functional data analysis and functional limits of agreement are sensitive methods for comparison of cyclical data and could be applied to differentiate changes in gait for individuals across time and conditions.

Introduction

In humans, objective clinical gait analysis is widely applied (Wren et al., 2011) such as in cerebellar ataxia (Helwig et al., 2011, Serrao et al., 2012), spinal cord injury (Gil-Agudo et al., 2011, McDermott et al., 2010) and is considered crucial in the assessment of cerebral palsy (Chang et al., 2010).

Inertial measurement units (IMUs) provide an opportunity to collect stride series with the subject moving with fewer constraints than in a gait laboratory or on a treadmill. IMUs are increasingly applied in ambulatory monitoring of spatiotemporal kinematics in humans (Fong and Chan, 2010, Rueterbories et al., 2010, Saber-Sheikh et al., 2010, Schwesig et al., 2011) and for lameness assessment in horses (Barrey and Desbrosse, 1996, Keegan et al., 2011, Pfau et al., 2007, Thomsen et al., 2010).

In order to justify the use of limb-mounted IMUs to determine displacement (local position estimate) during gait analysis in horses, it is crucial to determine accuracy and precision. Accuracy and precision for IMU derived displacement have previously been determined for upper body landmarks in horses (Pfau et al., 2005, Warner et al., 2010) and centre of mass (CoM) in humans (Esser et al., 2009) as well as foot movement in humans (Mariani et al., 2010). However, the high impact, vibrations and dynamic range of rotation observed for the distal limb in the horse (Gustas et al., 2001, Wilson et al., 2003, Witte et al., 2004) constitute a particularly challenging environment for IMU sensor fusion approaches. A recent attempt at obtaining accuracy and precision from hoof mounted IMUs revealed measurement errors above 10% for latero-medial and dorso-ventral position estimates during walk and trot (Moorman et al., 2012).

While consensus amongst previous IMU validation studies (Mariani et al., 2010, Pfau et al., 2005, Schepers et al., 2010, Warner et al., 2010) provide root mean square (RMS) differences or accuracy defined as bias and limits of agreement as described by Bland and Altman (1986) and precision across all measurements throughout a stride, there is currently no agreement on a standardized statistical method to assess differences throughout a step cycle between 3D motion capture methods.

The aim of this study is to investigate the suitability of IMUs to quantify displacement of the distal limb in horses outside the gait laboratory. The objective is to compare displacement derived from distal limb mounted IMUs to motion capture (as the reference standard) using functional limits of agreement.

In contrast to Olsen et al. (2012) where we investigated accuracy and precision of temporal gait events extracted from limb mounted IMUs, here we compare spatial parameters between motion capture and IMUs.

Section snippets

Materials and methods

The following section briefly describes the same horses used in Olsen et al. (2012) and emphasises the differences in processing of motion capture and IMU data.

Data acquisition and processing

Data were acquired and processed as described in Olsen et al. (2012). A 36 mm reflective marker was centred over each distal limb IMU and a 26 mm reflective marker was placed over the estimated location of the Centre of Mass (CoM) on both sides of the horse (Buchner et al., 2000). Motion was recorded in a right-handed Cartesian coordinate system with cranio-caudal (X, positive forwards) latero-medial (Y, positive left) and dorso-ventral (Z, positive upwards). Motion capture was acquired with 12

Results

Outcome measures from the agreement analysis are summarised in Table 1 for 30 front limb steps and Table 2 for 28 hind limb steps. The average error is between 0.6% and 9.8% for all axes. The maximum error for cranio-caudal displacement is 5.1% for front limb and 6.1% for hind limb. For the dorso-ventral displacement the maximum error is 13.4% for front limbs and 6.2% for hind limbs, whereas the latero-medial maximum error ranges from 105.7% for hind limbs to 110.7% for front limbs.

Functional

Discussion

When the traditional agreement analysis (Bland and Altman, 2007) is applied across the entire stride, the measurement error is below 5%. Bland and Altman (2007) points out that the limits of agreement must be assessed to decide whether a method is sufficiently accurate and precise. The functional data analysis indicated markedly higher variation across and within strides for the latero-medial directions compared to the cranio-caudal direction. Fig. 1 shows the difference for the cranio-caudal

Conflicts of interest

We have no conflicts of interest to disclose.

Acknowledgements

We would like to acknowledge the funding bodies; The RCVS trust, Kustos of 1881, University of Copenhagen, research school KLINIK and department of Large Animal Sciences as well as Danish Agency for Science Technology and Innovation. The funding bodies have not been involved in any parts of the study or in writing of the paper. We would also like to thank colleagues from the Structure & Motion Laboratory; Justin Perkins for help with horses, Victoria Unt for horse handling and Sandra Starke,

References (40)

  • R. Schwesig et al.

    Inertial sensor based reference gait data for healthy subjects

    Gait and Posture

    (2011)
  • T.A. Wren et al.

    Efficacy of clinical gait analysis: a systematic review

    Gait and Posture

    (2011)
  • E. Barrey et al.

    Lameness detection using an accelerometric device

    Pferdeheilkunde

    (1996)
  • Bates, D., Maechler, M., Bolker, B., 2012. lme4: Linear mixed-effects models using S4 classes. R Package. 0.999999-0...
  • J.M. Bland et al.

    Statistical methods for assessing agreement between two methods of clinical measurement

    Lancet

    (1986)
  • J.M. Bland et al.

    Agreement between methods of measurement with multiple observations per individual

    Journal of Biopharmaceutical Statistics

    (2007)
  • M.A. Brodie et al.

    Dynamic accuracy of inertial measurement units during simple pendulum motion

    Computer Methods in Biomechanics and Biomedical Engineering

    (2008)
  • Carstensen, B., Gurrin, L., Ekstrom, C., 2012. MethComp: functions for analysis of method comparison studies. R package...
  • M. Faber et al.

    Methodology and validity of assessing kinematics of the thoracolumbar vertebral column in horses on the basis of skin-fixated markers

    American Journal of Veterinary Research

    (2001)
  • J.J. Faraway

    Regression analysis for a functional response

    Technometrics

    (1997)
  • Cited by (16)

    • Detection of Equine Hoof Motion by Using a Hoof-Mounted Inertial Measurement Unit Sensor in Comparison to Examinations with an Optoelectronic Technique - A Pilot Study

      2021, Journal of Equine Veterinary Science
      Citation Excerpt :

      In the present study an established optoelectronic technique has been compared to a novel hoof-mounted IMU senor system to examine the motion of the equine hoof during swing and stance phase in walk and trot on two different grounds. Previous studies describing the use of hoof-mounted IMU sensors for equine motion analysis did not evaluate different parts of the stance phase in detail [5,12,13]. The comparison of the timing characteristics representing general motion of the hoof during swing and stance phase showed a high agreement between the examination techniques.

    • The development and validation of using inertial sensors to monitor postural change in resistance exercise

      2016, Journal of Biomechanics
      Citation Excerpt :

      It is assumed that other outputs including absolute angles, angular rates of change, distance travelled and acceleration are also accurate measures of resistance exercise technique, due to similar past movement validations during other activities (McCamley et al., 2012; Olsen et al., 2013; Trojaniello et al., 2014). Although these past validations do not directly monitor resistance exercise, they demonstrate significant inertial sensor validity results (Olsen et al., 2013; Saber-Sheikh et al., 2010). These past validations support that inertial sensors can accurately monitor resistance exercise technique with acceleration and gyroscope outputs, further warranting the validation assessment and application of these outputs, specific to resistance exercise.

    • A quantitative comparison of two kinematic protocols for lumbar segment motion during gait

      2015, Gait and Posture
      Citation Excerpt :

      Functional Limits of Agreement (FLoA) were calculated to assess agreement between gait curves recorded by each model [26]. This approach expands on the Limits of Agreement described by Bland and Altman [27] and allows the functional data structure for the entire stride to be examined [28]. In the case of where the mean difference follows the zero line closely and the width of the FLoA are relatively small, this would indicate good agreement between protocols.

    • Accuracy and precision of gait events derived from motion capture in horses during walk and trot

      2014, Journal of Biomechanics
      Citation Excerpt :

      Current techniques for lameness evaluation use inertial sensors placed on head, trunk and sacrum. Kinematics of the distal limb could be of further potential (Moorman et al., 2012; Olsen et al., 2013). Motion capture and force plates have the potential to aid assessment of deficits in neuro-motor control on a spinal or supraspinal level because spatial and temporal characteristics are primarily controlled through the spinal and supra-spinal neural pathways (Martinez et al., 2012; Rossignol and Frigon, 2011).

    • Effect of turn direction on body lean angle in the horse in trot and canter

      2014, Veterinary Journal
      Citation Excerpt :

      Facilitated by technological development, kinetic and kinematic assessment of turning has recently attracted increasing interest (Wickler et al., 2003; Clayton and Sha, 2006; Hobbs et al., 2011; Pfau et al., 2012; Starke et al., 2012a; Chateau et al., 2013). Inertial measurement units (IMUs) provide the necessary ‘freedom of movement’ for the horse and allow accurate and precise measurement of upper body landmarks (Pfau et al., 2005; Warner et al., 2010) and limb movements (Olsen et al., 2013) in the three different movement planes. Thus, IMUs are used frequently to assess movement symmetry in non-laboratory conditions (Keegan et al., 2011; Pfau et al., 2012; Starke et al., 2012a).

    View all citing articles on Scopus
    View full text