
180 Park Ave - Building 103
Florham Park, NJ
Assistive Technology,
At AT&T Labs - Research, we apply our speech, language and media technologies to give people with disabilities more independence, privacy and autonomy.
Content Augmenting Media (CAM),
Leverage multimedia metadata to provide live alerts and intelligent content consumption.
eClips - Personalized Content Clip Retrieval and Delivery,
The eClips project delivers customized video content based upon user profiles, based upon the MIRACLE platform.
iMIRACLE - Content Retrieval on Mobile Devices with Speech,
iMIRACLE uses large vocabulary speech recognition for content retrieval with metadata words (titles, genre, channels, etc.) and content words that occur in recorded programs.
MIRACLE and the Content Analysis Engine (CAE),
The Multimedia Information Retrieval by Content (MIRACLE) project encompasses the technologies for video indexing, analysis, and retrieval with audio, textual, and visual content information.
Social TV - View and Contribute to Public Opinions about Your Content Live,
Social TV - View and Contribute to Public Opinions about Your Content Live (to be revised)
Video - Content Delivery and Consumption,
A background on the delivery and consumption of video and multimedia and references to projects within the AT&T Video and Multimedia Technologies and Services Research Department.
Video - Indexing and Representation (Metadata),
Video and multimedia indexing and representations (i.e. metadata), their production, and use. Links to projects within the AT&T Video and Multimedia Technologies and Services Research Department.
Video and Multimedia Technologies Research,
The AT&T Video and Multimedia Technologies Research Department strives to acquire multimedia and video for indexing,retrieval,and consumption with textual,semantic,and visual modalities.

Large-Scale Analysis for Interactive Media Consumption
David Gibbon, Andrea Basso, Lee Begeja, Zhu Liu, Bernard Renger, Behzad Shahraray, Eric Zavesky
TV Content Analysis,
TV Content Analysis,
CRC Press,
2012.
[PDF]
[BIB]
CRC Press, Taylor Francis LLC Copyright
The definitive version was published in proceedings of TV Content Analysis (CRC Press/Taylor & Francis). , 2012-02-22, http://mklab.iti.gr/tvca/
Over the years the fidelity and quantity of TV content has steadily increased, but consumers
are still experiencing considerable difficulties in finding the content matching their personal
interests. New mobile and IP consumption environments have emerged with the promise
of ubiquitous delivery of desired content, but in many cases, available content descriptions
in the form of electronic program guides lack sufficient detail and cumbersome human interfaces yield a less than positive user experience. Creating metadata through a detailed
manual annotation of TV content is costly and, in many cases, this metadata may be lost
in the content life-cycle as assets are repurposed for multiple distribution channels. Content
organization can be daunting when considering domains from breaking news contributions,
local or government channels, live sports, music videos, documentaries up through dramatic
series and feature films. As the line between TV content and Internet content continues
to blur, more and more long tail content will appear on TV and the ability to be able to
automatically generate metadata for it becomes paramount. Research results from several
disciplines must be brought together to address the complex challenge of cost effectively augmenting existing content descriptions to facilitate content personalization and adaptation for
users given todays range of content consumption contexts.This chapter presents systems architectures for processing large volumes of video efficiently, practical, state of the art solutions for TV content analysis and metadata generation,
and potential applications that utilize this metadata in effective and enabling ways.

Enhancing Social TV through Social Media Mining
Junlan Feng, Bernard Renger, Ovidiu Dan
TV Content Analysis,
2012.
[PDF]
[BIB]
{This chapter will give an overview of recent media mining technologies and their applica-
tions to TV-related services. In particular, we will cover three main themes related to Social
TV. First, we will discuss retrieving social media content related to TV program. Some TV
shows such as "Lost" and "Heroes" have titles that are also common terms. Using these
titles as keywords to search for relevant messages will lead to low precision. Conversely,
many shows have long titles, which results in low recall as users don't use the full name
of the shows. Appropriately retrieved social media content can be used to display social
discussions on certain TV shows. Furthermore, retrieving such data with high precision and
recall is crucial to a wide spectrum of applications and data mining algorithms.
The second theme is social media mining for TV services. We will focus on sentiment
analysis and detection of in
uential users in social networks. Analyzing messages for sen-
timent can help uncover the aggregate opinion of a large number of users with respect to
certain TV shows or episodes. It can also be useful in presenting opposing views on the same
subject. Graph analysis can be used to determine the most in
uential users which discuss
certain TV programs.
The third theme is integrating the information mined from social media into Social TV
interfaces. This section describes the technologies that enable a user to interact with social
media through television sets. We will present VoiSTV, a voice-enabled social TV prototype
system created at AT&T Labs Research. We will also discuss previous work in this area, as
well as trends in the industry.}

Voice-Enabled Social TV
Bernard Renger, Junlan Feng, Ovidiu Dan, Hisao Chang, Luciano Barbosa
WWW2011,
2011.
[PDF]
[BIB]
ACM Copyright
The definitive version was published in WWW 2011. , 2011-03-28
{Until today, the TV viewing experience has been very unsocial compared to the World Wide Web. In this demo, we will present a Voice-enabled Social TV system, VoiSTV, which allows users to access twitter through the TV using voice. With this application, a user can receive and send twitter messages (tweets) through the TV while watching TV. Users can input tweets to be sent using spoken language. Beyond accessibility, VoiSTV also provides users metadata information about TV shows such as trends, hot topics, popularity of the show as well as aggregated sentiment of show-related tweets. }
Automated Demographic Analysis By Analyzing Voice Activity,
Tue Oct 30 16:12:08 EDT 2012
A method of generating demographic information relating to an individual is provided. The method includes monitoring an environment for a voice activity of an individual and detecting the voice activity of the individual. The method further includes analyzing the detected voice activity of the individual and determining, based on the detected voice activity of the individual, a demographic descriptor of the individual.
System And Method For Categorizing Long Documents,
Tue Aug 28 16:11:36 EDT 2012
A system, a method, an apparatus, and a computer-readable medium are provided. Each of a group of documents is segmented. Categories are assigned to each segment of the group of documents. A categorization series for each one of the group of documents is formed, based at least in part, on the categories assigned to each of the segments of respective ones of the plurality of documents. A pattern is found based, at least in part, on the plurality of categorization series corresponding to the plurality of documents. Each of the group of documents is categorized based, at least in part, on the pattern.
System And Method Of Providing An Automated Data-Collection In Spoken Dialog Systems,
Tue May 22 16:10:28 EDT 2012
The invention relates to a system and method for gathering data for use in a spoken dialog system. An aspect of the invention is generally referred to as an automated hidden human that performs data collection automatically at the beginning of a conversation with a user in a spoken dialog system. The method comprises presenting an initial prompt to a user, recognizing a received user utterance using an automatic speech recognition engine and classifying the recognized user utterance using a spoken language understanding module. If the recognized user utterance is not understood or classifiable to a predetermined acceptance threshold, then the method re-prompts the user. If the recognized user utterance is not classifiable to a predetermined rejection threshold, then the method transfers the user to a human as this may imply a task-specific utterance. The received and classified user utterance is then used for training the spoken dialog system.
Systems And Methods For Monitoring Speech Data Labelers,
Tue May 01 16:10:18 EDT 2012
Systems and methods herein use an annotation guide to label utterances and speech data with a call type. A system practicing the method embodiment monitors labelers of speech data by presenting via a processor a test utterance to a labeler, receiving input from the labeler that selects a particular call type from a list of call types and determining via the processor if the labeler labeled the test utterance correctly. Based on the determining step, the system revises the annotation guide, retrains the labeler, and/or alters the test utterance.
Index Of Locally Recorded Content,
Tue Jan 03 16:08:52 EST 2012
A method to index locally recorded content at a media device includes extracting, at a remote service provider, event index data from an event being locally recorded at a media device and associating the event index data with locator code data of the event. The method further includes storing, at the remote service provider, the extracted event index data and the associated locator code data; searching the extracted event index data for a plurality of segments associated with the event, the search being associated with a search request; determining index display data for a presentation of the plurality of segments based on the search request; and transmitting, to the media device, the locator code data associated with the plurality of segments, and the index display data.
System And Method For Automatically Authoring Interactive Television Content,
Tue Oct 11 16:06:17 EDT 2011
A system and method is provided to automatically generate content for ITV products and services by processing primary media sources. In one embodiment of the invention, keywords are automatically extracted from the primary media sources using one or more of a variety of techniques directed to video, audio and/or textual content of the multimodal source. In some embodiments, keywords are then processed according to one or more disclosed algorithms to narrow the quantity of downstream processing that is necessary to associate secondary sources (reference items) with the primary video source. Embodiments of the invention also provide automatic searching methods for the identification of reference items based on the processed keywords in order to maximize the value added by the association of reference items to the video source.
System And Method For Managing Request Priority In A Telecommunications Network,
Tue Apr 19 16:04:57 EDT 2011
A method and system for managing requests in a hold queue and the responses thereto are described. By providing a management system for handling requests in a call queue, a requesting party may be free to perform other tasks while waiting for a response. In addition, the management system may modify request priority independently of a party receiving the request. The method and system may further facilitate the entry of request related information by implementing an information database. The flexibility of a receiving party in responding to a request may also be enhanced through a greater selection of response options. The management system and method may further provide automatic backup and secondary options if a receiving party's first option is unfeasible.
System And Method For Adaptive Content Rendition,
Tue Sep 14 15:04:37 EDT 2010
Disclosed herein are systems, methods, and computer readable-media for adaptive content rendition, the method comprising receiving media content for playback to a user, adapting the media content for playback on a first device in the user's first location, receiving a notification when the user changes to a second location, adapting the media content for playback on a second device in the second location, and transitioning media content playback from the first device to second device. One aspect conserves energy by optionally turning off the first device after transitioning to the second device. Another aspect includes playback devices that are "dumb devices" which receive media content already prepared for playback, "smart devices" which receive media content in a less than ready form and prepare the media content for playback, or hybrid smart and dumb devices. A single device may be substituted by a plurality of devices. Adapting the media content for playback is based on a user profile storing user preferences and/or usage history in one aspect.
Method For Creating And Providing Layered Syndicated Data For Multimedia Content To Users,
Tue May 18 15:50:00 EDT 2010
A layered syndicated feed or content is provided having layers defined according to a media type (e.g., text, graphic, audio, or video) wherein each layer has a plurality of levels such that each level provides either inclusive or exclusive content of the layer's media type in varying degrees of detail or depth. Furthermore, a system is provided for requesting and storing user and mobile device profiles indicative of the syndicated content layers and levels that the user is interested in receiving and that the user's mobile device is capable of receiving.
Systems And Methods For Monitoring Speech Data Labelers,
Tue May 04 15:03:49 EDT 2010
Systems and methods for using an annotation guide to label utterances and speech data with a call type. A method embodiment monitors labelers of speech data by presenting via a processor a test utterance to a labeler, receiving input from the labeler that selects a particular call type from a list of call types and determining via the processor if the labeler labeled the test utterance correctly. Based on the determining step, the method performs at least one of the following: revising the annotation guide, retraining the labeler or altering the test utterance.
Systems and methods for monitoring speech data labelers,
Tue Oct 09 18:12:17 EDT 2007
Systems and methods for monitoring labelers of speech data. To test or train labelers, a labeler is presented with utterances that have already been identified as belonging to a particular class or call type. The labeler is asked to assign a call type to the utterances. The performance of the labeler is measured by comparing the call types assigned by the labeler with the existing call types of the utterances. The performance of a labeler can also be monitored as the labeler labels speech data by occasionally having the labeler label an utterance that is already labeled and by storing the results.
Systems and methods for generating an annotation guide,
Tue May 15 18:12:01 EDT 2007
Systems and methods for generating an annotation guide. Speech data is organized and presented to a user. After the user selects some of the utterances in the speech data, the selected utterances are included in a class and/or call type. Additional utterances that belong to the class and/or call type can be found in the speech data using relevance feedback, data mining, data clustering, support vector machines, and the like. After a call type is complete, it is committed to the annotation guide. After all call types are completed, the annotation guide is generated.
Reducing calling costs for wireless phones using multiple mobile identification numbers,
Tue Feb 25 18:08:38 EST 2003
A pseudo proxy server is provided for a host network when the host network experiences periods of congestion. The host network determines whether an arrival rate of data requests exceeds a predetermined threshold. If so, the host network adds an address of a pseudo proxy server to a list of servers aliased to the host network. Thereafter, data requests are routed to the pseudo proxy server on a round robin basis. The pseudo proxy server may be engaged without first loading information content from the host network on the pseudo proxy server.
Multiple uniquely distinguishable wireless handsets using a single mobile identification number,
Tue Dec 31 18:08:36 EST 2002
A system, method, and computer program product that permits multiple uniquely identifiable handsets to use the same mobile identification number (MIN). The apparatus includes a wireless phone including an electronic serial number (ESN) and an extended MIN (EMIN), the EMIN including a MIN identifying a plurality of wireless phones and an extension code identifying the specific wireless phone within the plurality of wireless phones that includes it; an adjunct processor that generates control codes according to a network-based profile identified by the EMIN; and a mobile switching center that activates a services plan according to the control codes, thereby providing telecommunication service access to the wireless phone.
System And Method For Automated Emergency Call Breakthrough,
Tue Mar 27 18:07:01 EST 2001
An emergency breakthrough system allows users to break through a busy signal, using an automated rather than operator assisted technique. Upon receipt of a busy signal, rather than hanging up and dialing an operator to gain a manual assistance for third party call breakthrough, the calling party is able to keypad an enablement request, such as *85, requesting emergency call breakthrough. After that entry, the system awaits a breakthrough passcode, such as a four digit number, which if validated permits the user to breakthrough the busy signal and reach the called party, without operator intervention. Predesignated numbers can gain automated access by ANI identity of the calling number.
Method And Apparatus For Adaptive Monitor And Support System,
Tue Feb 20 18:06:59 EST 2001
This invention provides an adaptive monitor and support system that adapts a monitoring process for monitored devices based on monitored data by downloading instructions and/or monitor/support programs to optimize the monitoring process. A monitor/support shell executes in intelligent monitored devices such as personal computers. For non- intelligent devices, intelligent monitor devices are provided to support the monitor/ supporting shell. A profile corresponding to each monitored device identifies device functions that require special monitor and/or support processes which are downloaded from an adaptive monitor and support device located remotely relative to the monitored device. The adaptive monitor and support device analyzes uploaded monitored data and adjusts the monitoring process based on the analysis results by downloading special monitor programs, special support programs, and/or instructions to the monitored devices. The special monitor and/or support programs may also be downloaded directly from third-party databases.
System and Method For Monitoring Information Flow and Performing Data Collection,
Tue Oct 12 18:05:23 EDT 1999
This patent is a continuation in part of patent 5878384 (granted 2 March 1999). It also covers monitoring and collecting bi-directional data during a real-time interaction between a user on a PC and an online service. In addition, it covers monitoring and collecting desktop activity. In both cases, the modem and desktop activity information is intercepted at the virtual device driver level using special stub modules. This software was used for the Celebration Panel (1996-1997) as part of an overall program to gather information on consumer usage behavior (PC, Online/Internet, phone, TV, print media, etc.).
System and Method For Monitoring Information Flow and Performing Data Collection,
Tue Mar 02 18:05:10 EST 1999
This patent covers monitoring and collecting bi-directional data during a real-time interaction between a user on a PC and an online service. The modem data is intercepted at the virtual device driver level using a special stub module. This software was used for the Celebration Panel (1996-1997) as part of an overall program to gather information on consumer usage behavior (PC, Online/Internet, phone, TV, print media, etc.).
System for providing personalized telephone calling features,
Tue Jun 22 18:04:59 EDT 1993
A common adjunct switch integrated with a telecommunications network and associated with a plurality of predetermined telephone numbers prefixed by a common code is provided with a facility which allows telephone subscribers that are assigned respective ones of the telephone numbers to personalize the way in which they receive long distance telephone calls. For example, such a subscriber may program his/her associated service record to put into effect call forwarding or call screening. In addition, each such subscriber may be associated with one or more caller identification numbers, in which a caller identification number is used to determine whether a call placed to a service number is billed to the called subscriber or the calling party.