Overview

Modern representation learning techniques like deep neural networks have had a major impact both within and beyond the field of machine learning, achieving new state-of-the-art performances with little or no feature engineering on a vast array of tasks. However, these gains are often difficult to translate into real-world settings as they require massive hand-labeled training sets. And in the vast majority of real-world settings, collecting such training sets by hand is infeasible due to the cost of labeling data or the paucity of data in a given domain (e.g. rare diseases in medical applications). In this workshop we focus on techniques for few sample learning and using weaker supervision when large unlabeled datasets are available, as well as theory associated with both.

One increasingly popular approach is to use weaker forms of supervision—i.e. supervision that is potentially noisier, biased, and/or less precise. An overarching goal of such approaches is to use domain knowledge and resources from subject matter experts, but to solicit it in higher-level, lower-fidelity, or more opportunistic ways. Examples include higher-level abstractions such as heuristic labeling rules, feature annotations, constraints, expected distributions, and generalized expectation criteria; noisier or biased labels from distant supervision, crowd workers, and weak classifiers; data augmentation strategies to express class invariances; and potentially mismatched training data such as in multitask and transfer learning settings.

Along with practical methods and techniques for dealing with limited labeled data settings, this workshop will also focus on the theory of learning in this general setting. Although several classic techniques in the statistical learning theory exist which handle the case of few samples and high dimensions, extending these results for example to the recent success of deep learning is still a challenge. How can the theory or the techniques that have gained success in deep learning be adapted to the case of limited labeled data? How can systems designed (and potentially deployed) for large scale learning be adapted to small data settings? What are efficient and practical ways to incorporate prior knowledge? This workshop will focus on highlighting both practical and theoretical aspects of learning with limited labeled data, including but not limited to topics such as:

  • Learning from noisy labels
  • Distant or heuristic supervision
  • Non-standard labels such as feature annotations, distributions, and constraints
  • Zero-shot, one-shot, transfer, and multi-task learning
  • Data augmentation and/or the use of simulated data
  • Frameworks that can tackle both very few samples and settings with more data without extensive intervention
  • Effective and practical techniques for incorporating domain knowledge
  • Applications of machine learning for small data problems in medical images and industry.

December 9 2017

Location TBA

Seats TBA

8 Speakers

Speakers

Andrew McCallum

University of Massachusetts Amherst

Tom Mitchell

Carnegie Mellon University

Gaël Varoquaux

INRIA

Ian Goodfellow

Google Brain

Sebastien Riedel

University College London/Bloomsbury AI.

Raquel Urtasun

University of Toronto/Uber ATG Toronto

Additional speakers awaiting final confirmation!

Submit a Contribution

Please format your papers using the standard NIPS 2017 style files. The page limit is 5 pages (excluding references).
Please do not include author information, submissions must be made anonymous. All accepted papers will be presented as posters(poster dimensions: 36 x 48 in. (91cm x 122cm)), with exceptional submissions also presented as oral talks.

Our sponsors, CFM and Owkin, will provide best paper awards.(will be specified soon)

  • Submission site: https://easychair.org/conferences/?conf=lld2017
  • Style files: https://nips.cc/Conferences/2017/PaperInformation/StyleFiles
  • Submissions are reviewed through a double-blind process.
  • Cross-submissions are allowed, yet please clearly indicate if the submitted work has been presented somewhere else. Accepted papers will not be archived, thus submission does not preclude publications in other venues.
  • We strongly encourage at least one author per submission to attend the workshop to present in person, however due to registration difficulties this year, submissions with no attending authors will still be considered.
  • Email organizing chairs: lld2017[at]googlegroups[dot]com

Important dates

  • Submission deadline: October 29, 2017
  • Notification of acceptance: November 13, 2017
  • Camera-ready Due: November 20, 2017
  • Workshop: December 9, 2017

Event Schedule (Tentative)

8:30 AM: Welcome
8:40 AM: Invited Talk 1
9:10 AM: Invited Talk 2
9:40 AM: Oral Presentation 1
9:55 AM: Oral Presentation 2
10:10 AM: 1-minute poster spotlights
10:30 AM: Coffee Break
11:00 AM: Invited Talk 3
11:30 AM: Invited Talk 4
12:00 Noon: Lunch
1:00 PM: Poster Session
2:00 PM: Oral Presentation 3
2:15 PM: Panel 1
3:00 PM: Coffee Break
3:30 PM: Invited Talk 5
4:00 PM: Invited Talk 6
4:30 PM: Panel 2
5:15 PM: Invited Talk 7
5:45 PM: Invited Talk 8
6:15 PM: Closing Remarks

Workshop Sponsors