Intuitive computing methods and systems

Procédé et système pour le calcul informatisé intuitif

Abstract

Un téléphone intelligent détecte des sons, des images et/ou un autre stimulus provenant de l'environnement d'un utilisateur, et agit de manière autonome pour répondre aux souhaits déduits ou prévus de l'utilisateur. Selon un aspect de l'invention, la technologie décrite concerne la cognition, à l'aide d'un téléphone, d'une scène vue par l'appareil photo de ce téléphone. Les tâches de traitement d'image appliquées à la scène peuvent être sélectionnées parmi différentes possibilités, avec une prise en compte des coûts des ressources, des contraintes de ressources, d'autres informations constituant des stimuli (par exemple des sons), de la substituabilité des tâches, etc. Le téléphone peut appliquer plus ou moins de ressources à une tâche de traitement d'image en fonction du bon ou du mauvais déroulement de la tâche, ou de l'intérêt apparent de l'utilisateur pour la tâche. Dans certaines configurations, les données peuvent être envoyées au nuage à des fins d'analyse ou de glanage. La cognition et l'identification de la réponse ou des réponses qui conviennent de la part du dispositif peuvent être favorisées par des informations auxiliaires, telles que le contexte. Un grand nombre d'autres caractéristiques et configurations sont également décrites.
A smart phone senses audio, imagery, and/or other stimulus from a user's environment, and acts autonomously to fulfill inferred or anticipated user desires. In one aspect, the detailed technology concerns phone-based cognition of a scene viewed by the phone's camera. The image processing tasks applied to the scene can be selected from among various alternatives by reference to resource costs, resource constraints, other stimulus information (e.g., audio), task substitutability, etc. The phone can apply more or less resources to an image processing task depending on how successfully the task is proceeding, or based on the user's apparent interest in the task. In some arrangements, data may be referred to the cloud for analysis, or for gleaning. Cognition, and identification of appropriate device response(s), can be aided by collateral information, such as context. A great number of other features and arrangements are also detailed.

Claims

Description

Topics

Download Full PDF Version (Non-Commercial Use)

Patent Citations (5)

    Publication numberPublication dateAssigneeTitle
    US-2002126879-A1September 12, 2002Isao Mihara, Miwako DoiImage recognition apparatus and method
    US-2009018828-A1January 15, 2009Honda Motor Co., Ltd.Automatic Speech Recognition System
    US-2009204410-A1August 13, 2009Sensory, IncorporatedVoice interface and search for electronic devices including bluetooth headsets and remote systems
    US-6546262-B1April 08, 2003Altec Lansing Technologies, Inc.Cellular telephone accessory device for a personal computer system
    WO-2010022185-A1February 25, 2010Digimarc CorporationMethods and systems for content processing

NO-Patent Citations (2)

    Title
    JIE YANG ET AL.: "Smart Sight: a tourist assistant system", DIGEST OF PAPERS. THE THIRDINTERNATIONAL SY MPOSIUM ON SAN FRANCISCO, 1999
    See also references of EP 2559030A4

Cited By (85)

    Publication numberPublication dateAssigneeTitle
    US-9300784-B2March 29, 2016Apple Inc.System and method for emergency calls initiated by voice command
    US-9785630-B2October 10, 2017Apple Inc.Text prediction using combined word N-gram and unigram language models
    US-9668024-B2May 30, 2017Apple Inc.Intelligent automated assistant for TV user interactions
    US-9697822-B1July 04, 2017Apple Inc.System and method for updating an adaptive speech recognition model
    US-9323902-B2April 26, 2016Verance CorporationConditional access using embedded watermarks
    US-9858925-B2January 02, 2018Apple Inc.Using context information to facilitate processing of commands in a virtual assistant
    US-9318108-B2April 19, 2016Apple Inc.Intelligent automated assistant
    US-9697820-B2July 04, 2017Apple Inc.Unit-selection text-to-speech synthesis using concatenation-sensitive neural networks
    US-9626955-B2April 18, 2017Apple Inc.Intelligent text-to-speech conversion
    WO-2014112973-A1July 24, 2014Hewlett-Packard Development Company, L.P.Server-platform simulation service
    US-9842105-B2December 12, 2017Apple Inc.Parsimonious continuous-space phrase representations for natural language processing
    WO-2014197730-A1December 11, 2014Apple Inc.Application gateway for providing different user interfaces for limited distraction and non-limited distraction contexts
    US-9888105-B2February 06, 2018Digimarc CorporationIntuitive computing methods and systems
    US-8489115-B2July 16, 2013Digimarc CorporationSensor-based mobile search, related methods and systems
    US-9153006-B2October 06, 2015Verance CorporationCircumvention of watermark analysis in a host content
    US-9495129-B2November 15, 2016Apple Inc.Device, method, and user interface for voice-activated navigation and browsing of a document
    US-9854331-B2December 26, 2017Verance CorporationInteractive content acquisition using embedded codes
    US-9838641-B1December 05, 2017Google LlcLow power framework for processing, compressing, and transmitting images at a mobile image capture device
    US-9483461-B2November 01, 2016Apple Inc.Handling speech synthesis of content for multiple languages
    WO-2017027339-A1February 16, 2017Google Inc.Commande basée sur une vision d'ordinateur et une parole
    US-9609117-B2March 28, 2017Digimarc CorporationMethods and arrangements employing sensor-equipped smart phones
    US-9330720-B2May 03, 2016Apple Inc.Methods and apparatus for altering audio output signals
    US-9454964-B2September 27, 2016Samsung Electronics Co., Ltd.Interfacing device and method for supporting speech dialogue service
    US-9009482-B2April 14, 2015Verance CorporationForensic marking using a common customization function
    US-9262793-B2February 16, 2016Verance CorporationTransactional video marking system
    US-9596521-B2March 14, 2017Verance CorporationInteractive content acquisition using embedded codes
    US-9106964-B2August 11, 2015Verance CorporationEnhanced content distribution using advertisements
    US-9836819-B1December 05, 2017Google LlcSystems and methods for selective retention and editing of images captured by mobile image capture device
    US-9639911-B2May 02, 2017Verance CorporationWatermark detection using a multiplicity of predicted patterns
    US-9842101-B2December 12, 2017Apple Inc.Predictive conversion of language input
    US-9620104-B2April 11, 2017Apple Inc.System and method for user-specified pronunciation of words for speech synthesis and recognition
    US-9262794-B2February 16, 2016Verance CorporationTransactional video marking system
    US-9681203-B2June 13, 2017Verance CorporationInteractive content acquisition using embedded codes
    US-9548050-B2January 17, 2017Apple Inc.Intelligent automated assistant
    US-9208334-B2December 08, 2015Verance CorporationContent management using multiple abstraction layers
    US-9646609-B2May 09, 2017Apple Inc.Caching apparatus for serving phonetic pronunciations
    WO-2014199596-A1December 18, 2014パナソニック インテレクチュアル プロパティ コーポレーション オブ アメリカ話者識別方法、話者識別装置及び話者識別システム
    US-9836484-B1December 05, 2017Google LlcSystems and methods that leverage deep learning to selectively store images at a mobile image capture device
    US-9886432-B2February 06, 2018Apple Inc.Parsimonious handling of word inflection via categorical stem + suffix N-gram language models
    US-9865248-B2January 09, 2018Apple Inc.Intelligent text-to-speech conversion
    US-9711141-B2July 18, 2017Apple Inc.Disambiguating heteronyms in speech synthesis
    US-9854332-B2December 26, 2017Verance CorporationInteractive content acquisition using embedded codes
    US-9298891-B2March 29, 2016Verance CorporationEnhanced content management based on watermark extraction records
    US-9633674-B2April 25, 2017Apple Inc.System and method for detecting errors in interactions with a voice-based digital assistant
    US-9798393-B2October 24, 2017Apple Inc.Text correction processing
    JP-2013080476-AMay 02, 2013Apple Inc, アップル インコーポレイテッドバーチャルアシスタントのコマンド処理を容易にするためのコンテクスト情報の使用
    JP-2015534196-ANovember 26, 2015クゥアルコム・インコーポレイテッドQualcomm Incorporated, クゥアルコム・インコーポレイテッドQualcomm Incorporatedモバイルアプリケーション用プラットフォームとしての規則エンジン
    US-9262612-B2February 16, 2016Apple Inc.Device access using voice authentication
    US-9251549-B2February 02, 2016Verance CorporationWatermark extractor enhancements based on payload ranking
    US-9769543-B2September 19, 2017Verance CorporationEnhanced metadata and content delivery using watermarks
    US-9769367-B2September 19, 2017Google Inc.Speech and computer vision-based control
    US-9805434-B2October 31, 2017Verance CorporationContent management based on dither-like watermark embedding
    US-9668121-B2May 30, 2017Apple Inc.Social reminders
    WO-2014143424-A1September 18, 2014Motorola Mobility LlcMethod and apparatus for determining a motion environment profile to adapt voice recognition processing
    US-9886953-B2February 06, 2018Apple Inc.Virtual assistant activation
    US-9721566-B2August 01, 2017Apple Inc.Competing devices responding to voice triggers
    US-9595258-B2March 14, 2017Digimarc CorporationContext-based smartphone sensor logic
    US-9760559-B2September 12, 2017Apple Inc.Predictive text input
    US-9197736-B2November 24, 2015Digimarc CorporationIntuitive computing methods and systems
    US-9633660-B2April 25, 2017Apple Inc.User profiling for voice input processing
    JP-2016511863-AApril 21, 2016マイクロソフト テクノロジー ライセンシング,エルエルシー, マイクロソフト テクノロジー ライセンシング,エルエルシー複合現実感表示調整
    US-9117270-B2August 25, 2015Verance CorporationPre-processed information embedding system
    US-9818400-B2November 14, 2017Apple Inc.Method and apparatus for discovering trending terms in speech requests
    JP-2015501438-AJanuary 15, 2015ディジマーク コーポレイション, ディジマーク コーポレイション状況(Context)に基づくスマートフォンセンサロジック
    US-9338493-B2May 10, 2016Apple Inc.Intelligent automated assistant for TV user interactions
    US-9485089-B2November 01, 2016Verance CorporationStego key management
    US-9704211-B2July 11, 2017Verance CorporationSignal continuity assessment using embedded watermarks
    US-9189955-B2November 17, 2015Verance CorporationRemote control signaling using audio watermarks
    WO-2013137789-A1September 19, 2013Sca Hygiene Products AbMethod for assisting in locating an item in a storage location
    US-9602891-B2March 21, 2017Verance CorporationService signaling recovery for multimedia content using embedded watermarks
    US-9715875-B2July 25, 2017Apple Inc.Reducing the need for manual start/end-pointing and trigger phrases
    US-9576574-B2February 21, 2017Apple Inc.Context-sensitive handling of interruptions by intelligent digital assistant
    US-9706235-B2July 11, 2017Verance CorporationTime varying evaluation of multimedia content
    KR-101816375-B1January 08, 2018애플 인크.Application gateway for providing different user interfaces for limited distraction and non-limited distraction contexts
    US-9143603-B2September 22, 2015Digimarc CorporationMethods and arrangements employing sensor-equipped smart phones
    US-9535906-B2January 03, 2017Apple Inc.Mobile device having human language translation capability with positional feedback
    US-9251322-B2February 02, 2016Verance CorporationSignal continuity assessment using embedded watermarks
    US-9558526-B2January 31, 2017Verance CorporationSignal continuity assessment using embedded watermarks
    US-9646614-B2May 09, 2017Apple Inc.Fast, language-independent method for user authentication by voice
    US-9368114-B2June 14, 2016Apple Inc.Context-sensitive handling of interruptions
    US-9582608-B2February 28, 2017Apple Inc.Unified ranking with entropy-weighted information for phrase-based semantic auto-completion
    EP-2835798-A1February 11, 2015Samsung Electronics Co., LtdDispositif d'interface et procédé pour supporter un service de dialogue vocal
    US-9710219-B2July 18, 2017Panasonic Intellectual Property Corporation Of AmericaSpeaker identification method, speaker identification device, and speaker identification system
    US-9865280-B2January 09, 2018Apple Inc.Structured dictation using intelligent automated assistants
    JP-2015122104-AJuly 02, 2015アップル インコーポレイテッド, Apple Inc, アップル インコーポレイテッドバーチャルアシスタントのコマンド処理を容易にするためのコンテクスト情報の使用