Skip to content Skip to navigation
University of Warwick
  • Study
  • |
  • Research
  • |
  • Business
  • |
  • Alumni
  • |
  • News
  • |
  • About

University of Warwick
Publications service & WRAP

Highlight your research

  • WRAP
    • Home
    • Search WRAP
    • Browse by Warwick Author
    • Browse WRAP by Year
    • Browse WRAP by Subject
    • Browse WRAP by Department
    • Browse WRAP by Funder
    • Browse Theses by Department
  • Publications Service
    • Home
    • Search Publications Service
    • Browse by Warwick Author
    • Browse Publications service by Year
    • Browse Publications service by Subject
    • Browse Publications service by Department
    • Browse Publications service by Funder
  • Help & Advice
University of Warwick

The Library

  • Login
  • Admin

Data mining and compression : where to apply it and what are the effects?

Tools
- Tools
+ Tools

Taylor, Phillip M., Griffiths, Nathan, Xu, Zhou and Mouzakitis, Alexandros (2019) Data mining and compression : where to apply it and what are the effects? In: 8th SIGKDD International Workshop on Urban Computing, Anchorage, Alaska , 5 Aug 2019. Published in: Proceedings of the 8th SIGKDD International Workshop on Urban Computing doi:10.1145/1122445.1122456

[img]
Preview
PDF
WRAP-data-mining-compression-effects-Taylor-2019.pdf - Accepted Version - Requires a PDF viewer.

Download (1089Kb) | Preview
Official URL: https://doi.org/10.1145/1122445.1122456

Request Changes to record.

Abstract

In data mining it is important for any transforms made to training
data to be replicated on evaluation or deployment data. If they
is not, the model may perform poorly or be unable to accept the
input. Lossy data compression has other considerations, however,
for example it may not be known whether or not lossy compression
will be applied to deployment data, or if a variable compression
ratio is to be used. Furthermore, lossy data compression typically
reduces noise, which may not affect or even improve model performances, and performing feature selection on lossy data may
find better features than selecting from the original data. In this
paper, we investigate the effects of selecting features, learning, and
making predictions from data that has been compressed using lossy
transforms. Using vehicle telemetry data, we determine where in
the data mining methodology lossy compression is detrimental
or beneficial, and how it should be compressed. We also propose
a specialised feature selection approach that considers predictive
performance alongside compressibility, measured by compressing
them either individually or in a single concatenated stream

Item Type: Conference Item (Paper)
Subjects: Q Science > QA Mathematics > QA76 Electronic computers. Computer science. Computer software
Divisions: Faculty of Science, Engineering and Medicine > Science > Computer Science
Library of Congress Subject Headings (LCSH): Data mining, Data compression (Computer science) , Machine theory
Journal or Publication Title: Proceedings of the 8th SIGKDD International Workshop on Urban Computing
Publisher: ACM
Official Date: 5 August 2019
Dates:
DateEvent
5 August 2019Available
1 June 2019Accepted
DOI: 10.1145/1122445.1122456
Status: Peer Reviewed
Publication Status: Published
Access rights to Published version: Restricted or Subscription Access
RIOXX Funder/Project Grant:
Project/Grant IDRIOXX Funder NameFunder ID
EP/N012380/1[EPSRC] Engineering and Physical Sciences Research Councilhttp://dx.doi.org/10.13039/501100000266
UNSPECIFIEDJaguar Land RoverUNSPECIFIED
Conference Paper Type: Paper
Title of Event: 8th SIGKDD International Workshop on Urban Computing
Type of Event: Conference
Location of Event: Anchorage, Alaska
Date(s) of Event: 5 Aug 2019
Related URLs:
  • Organisation
  • Publisher

Request changes or add full text files to a record

Repository staff actions (login required)

View Item View Item

Downloads

Downloads per month over past year

View more statistics

twitter

Email us: wrap@warwick.ac.uk
Contact Details
About Us