Patent Issued for Accident re-creation using augmented reality (USPTO 11164356): Allstate Insurance Company

2021 NOV 24 (NewsRx) -- By a News Reporter-Staff News Editor at Insurance Daily News -- According to news reporting originating from Alexandria, Virginia, by NewsRx journalists, a patent by the inventors Dahlman, Jeraldine (Evanston, IL, US), Davis, Chase (Richardson, TX, US), filed on May 27, 2020, was published online on November 2, 2021.

The assignee for this patent, patent number 11164356, is Allstate Insurance Company (Northbrook, Illinois, United States).

Reporters obtained the following quote from the background information supplied by the inventors: “Augmented reality systems may provide a user with a virtual environment based on a real world environment adding digital elements to the real world environment by using a camera or inputted information. Augmented reality systems may provide a user interface allowing a user to interact with the live and/or virtual environment. For example, the user may manipulate electronic representations of objects in the augmented environment. Augmented reality user interfaces may be displayed on display interfaces such as user computing devices and user mobile devices.

“When an automobile accident occurs, owners may submit accident reports to police and/or claims under insurance policies that cover the accident. The owner may fill out a police report and a police officer may verify the police report. Additionally, the owner may fill out an insurance claim form listing the damaged areas and an insurer may evaluate the damage against the coverage of an insurance policy. The insurer may provide reimbursement in the form of a settlement, allowing the owner to repair the automobile.

“Additionally, processing an insurance claim following a vehicle accident can be a complex and time-consuming process. Individuals involved in the accident must exchange insurance information and file insurance claims. Insurance companies for the individuals involved in the accident must determine the amount of damage caused to the vehicles, pay out on insurance claims, and recover damages from the liable party.

“Current claims processing approaches may involve interaction with multiple insurance agents, claims adjusters, subrogation representatives, and the like. Accordingly, current approaches to claims processing may include the processing of paperwork, telephone calls, and face-to-face meetings. As a result, a significant amount of time can elapse between the time the claim is filed and final settlement of the claim. Therefore, a need exists for improved approaches to processing insurance claims in response to a vehicle accident.”

In addition to obtaining background information on this patent, NewsRx editors also obtained the inventors’ summary information for this patent: “Aspects of the disclosure relate to accident re-creation systems with an augmented reality system (and/or virtual reality system) that facilitate visualization of an accident and re-creation of an accident. The accident re-creation system provides the capability to re-create the accident site on a mobile device before or soon after leaving the scene utilizing augmented reality. Multiple users, such as other witnesses, other drivers, police officers, etc., may also provide input.

“According to an embodiment, an accident re-creation system may include a display interface in communication with an augmented reality visualization device and a camera in communication with the augmented reality visualization device. The display interface may be configured to present a graphical user interface comprising an augmented reality accident scene corresponding to a real world location and an accident site and a recommended object listing comprising one or more recommended objects for inclusion in the augmented reality accident scene. The camera may store one or more videos of the real world location and the accident site. Further, the augmented reality visualization device comprises: one or more processors; a first data source configured to store location information corresponding to the real world location and a second data source configured to store accident information corresponding to the accident site. The location information may comprise attributes of the real world location and a prior object listing of one or more prior objects associated with the real world location. The accident information may comprise the one or more videos from the camera. The augmented reality visualization device may further comprise memory storing instructions that, when executed by the one or more processors, cause the augmented reality visualization device to: generate the augmented reality accident scene corresponding to the accident site based at least in part on the accident information and the location information; generate the prior object listing comprising the one or more prior objects based at least in part on the prior object listing, wherein each of the one or more prior objects are associated with the location information; cause display of the augmented reality accident scene and the prior object listing on the display interface; receive first user input comprising a selection of one or more prior objects and an indication of a location in the accident site for the one or more prior objects from the prior object listing from the user; update the augmented reality accident scene to include a representation of the first prior object; and cause display of an updated augmented reality accident scene on the display interface.

“In further aspects, the accident re-creation system may include the augmented reality visualization device that further comprises a third data source configured to store user information corresponding to a user, wherein the user information comprises claim information and policy information. The augmented reality visualization device may further comprise a fourth data source configured to store participant information received from other participants in the accident site, wherein the participant information is received from one or more of the following: one or more other drivers, one or more witnesses, or one or more police officers. The augmented reality visualization device may further generate a list of areas of conflict based a comparison of the updated augmented reality accident scene and the participant information from the fourth data source. The camera may be located on a mobile device of the user. The location information may include one or more of the following: road configurations, stop light locations, road signs, lane configurations, trees, or buildings. The accident information may include one or more of the following: vehicles involved in the accident, motorcycles involved in the accident, or pedestrians involved in the accident. The accident information may include one or more speeds of vehicles involved in the accident. The accident information may include a weather description of the accident and a time of day of the accident. The prior objects associated with the real world location may be determined based on the one or more videos associated with the accident site.

“According to another embodiment, a method for an accident re-creation system, may comprise the following steps: recording, by a camera in communication with an augmented reality visualization device, one or more videos of an accident site and a real world location of the accident site, wherein the camera is located on a mobile device of a user; receiving, by the augmented reality visualization device, accident information corresponding to the accident site, wherein the accident information comprises the one or more videos from the camera; receiving, by an augmented reality visualization device, location information corresponding to the real world location, wherein the location information comprises attributes of the real world location and a prior object listing of one or more prior objects associated with the real world location; generating, by the augmented reality visualization device, an augmented reality accident scene corresponding to the real world location and the accident site and based on the accident information and the location information; generating, by the augmented reality visualization device, the prior object listing; presenting the augmented reality accident scene and the prior object listing to the user via a display interface on the mobile device; receiving, by the augmented reality visualization device, a selection of one or more prior objects and an indication of a location in the accident site for the one or more prior objects from the prior object listing from the user; updating, by the augmented reality visualization device, the augmented reality accident scene to include a representation of the one or more prior objects selected by the user; and presenting, by the augmented reality visualization device, an updated augmented reality scene on the display interface.

“According to yet another embodiment, an accident re-creation system may comprise a display interface in communication with an augmented reality visualization device and a camera located on a mobile device of a user and in communication with the augmented reality visualization device. The display interface may be configured to present a graphical user interface comprising an augmented reality accident scene corresponding to a real world location and an accident site and a recommended object listing comprising one or more recommended objects for inclusion in the augmented reality accident scene. The camera may store one or more videos of the real world location and the accident site. The augmented reality visualization device may comprise: one or more processors; a first data source configured to store location information corresponding to the real world location; a second data source configured to store accident information corresponding to the accident site; and a third data source configured to store participant information from other participants in the accident site. The location information may comprise attributes of the real world location and a prior object listing of one or more prior objects associated with the real world location. The accident information may comprise the one or more videos from the camera. The participant information may be received from one or more of the following: one or more other drivers, one or more witnesses, or one or more police officers. Further, the augmented reality visualization device may comprise memory storing instructions that, when executed by the one or more processors, cause the augmented reality visualization device to: generate the augmented reality accident scene corresponding to the accident site based at least in part on the accident information and the location information; cause display of the augmented reality accident scene on the display interface; and generate a list of areas of conflict based a comparison of the augmented reality accident scene and the participant information from the third data source.”

The claims supplied by the inventors are:

“1. A system comprising: a display interface in communication with an augmented reality visualization device, wherein the display interface is configured to present a graphical user interface comprising an augmented reality accident scene corresponding to a real world location and an accident site; a camera in communication with the augmented reality visualization device, wherein the camera stores one or more videos of the real world location and the accident site; and the augmented reality visualization device, wherein the augmented reality visualization device comprises: one or more processors; a first data source configured to store location information corresponding to the real world location, wherein the location information comprises attributes of the real world location; a second data source configured to store accident information corresponding to the accident site, wherein the accident information comprises the one or more videos from the camera; a third data source configured to store participant information received from other participants in the accident site, wherein the participant information is received from one or more of the following: one or more other drivers, one or more witnesses, or one or more police officers; a fourth data source configured to store vehicle information received from a plurality of sensors located on a vehicle of a user; a fifth data source configured to store dash camera video from a dash camera installed on one or more vehicles involved in the accident site, consolidating and storing the dash camera video from any dash cameras available; a sixth data source configured to store street camera video from one or more street cameras from one or more streets and buildings around the accident site, consolidating and storing the street camera video from any street cameras available; and memory storing instructions that, when executed by the one or more processors, cause the augmented reality visualization device to: generate the augmented reality accident scene corresponding to the accident site based at least in part on the accident information and the location information; generate a prior object listing comprising one or more prior objects, wherein each of the one or more prior objects is associated with the location information; cause display of the augmented reality accident scene and the prior object listing on the display interface; receive a first user input comprising an indication of a location in the accident site from the user; update the augmented reality accident scene to include a representation of the first user input; cause display of an updated augmented reality accident scene on the display interface; analyze and compare the updated augmented reality accident scene, the participant information, the vehicle information, the dash camera video, and the street camera video; and generate a list of areas of conflict based on the analysis and comparison of the updated augmented reality accident scene, the participant information, the vehicle information, the dash camera video, and the street camera video to validate and confirm the updated augmented reality accident scene.

“2. The system of claim 1, wherein the augmented reality visualization device further comprises a seventh data source configured to store user information corresponding to the user, wherein the user information comprises insurance claim information and insurance policy information.

“3. The system of claim 1, wherein the camera is located on a mobile device of the user.

“4. The system of claim 1, wherein the location information includes one or more of the following: road configurations, stop light locations, road signs, lane configurations, trees, or buildings.

“5. The system of claim 1, wherein the accident information includes one or more of the following: vehicles involved at the accident site, motorcycles involved at the accident site, or pedestrians involved at the accident site.

“6. The system of claim 1, wherein the accident information includes one or more speeds of vehicles involved at the accident site.

“7. The system of claim 1, wherein the accident information includes a weather description of the accident site and a time of day of the accident site.

“8. The system of claim 1, wherein the real world location is determined based on the one or more videos associated with the accident site.

“9. The system of claim 1, with the memory storing instructions that cause the augmented reality visualization device further to: generate and display on the display interface a replay video of the augmented reality accident scene, wherein the user interface presents a three-dimensional view of the augmented reality accident scene.

“10. The system of claim 1, with the memory storing instructions that cause the augmented reality visualization device further to: receive user input on the display interface from the user to navigate within and interact with the augmented reality accident scene.

“11. A method comprising: recording, by a camera in communication with an augmented reality visualization device, one or more videos of an accident site and a real world location of the accident site, wherein the camera is located on a mobile device of a user; receiving, by the augmented reality visualization device, accident information corresponding to the accident site, wherein the accident information comprises the one or more videos from the camera; receiving, by the augmented reality visualization device, location information corresponding to the real world location, wherein the location information comprises attributes of the real world location; receiving, by the augmented reality visualization device, participant information received from other participants in the accident site, wherein the participant information is received from one or more of the following: one or more other drivers, one or more witnesses, or one or more police officers; receiving, by the augmented reality visualization device, vehicle information received from a plurality of sensors located on a vehicle of the user; receiving, consolidating, and storing, by the augmented reality visualization device, dash camera video from a dash camera installed on one or more vehicles involved at the accident site; receiving, consolidating, and storing, street camera video from one or more street cameras from one or more streets and buildings around the accident site; generating, by the augmented reality visualization device, an augmented reality accident scene corresponding to the real world location and the accident site and based on the accident information and the location information; generating, by the augmented reality visualization device, a prior object listing comprising one or more prior objects, wherein each of the one or more prior objects is associated with the location information; presenting the augmented reality accident scene and the prior object listing to the user via a display interface on the mobile device; receiving, by the augmented reality visualization device, a first user input of an indication of a location in the accident site from the user; updating, by the augmented reality visualization device, the augmented reality accident scene to include a representation of the first user input; causing, by the augmented reality visualization device, display of an updated augmented reality accident scene on the display interface; analyzing and comparing the updated augmented reality accident scene, the participant information, the vehicle information, the dash camera video, and the street camera video; and generating a list of areas of conflict based on the analysis and comparison of the updated augmented reality accident scene, the participant information, the vehicle information, the dash camera video, and the street camera video to validate and confirm the updated augmented reality accident scene.

“12. The method of claim 11, wherein the location information includes one or more of the following: road configurations, stop light locations, road signs, lane configurations, trees, or buildings.

“13. The method of claim 11, wherein the accident information includes one or more of the following: vehicles involved at the accident site, motorcycles involved at the accident site, or pedestrians involved at the accident site.

“14. The method of claim 11, wherein the accident information includes one or more speeds of vehicles involved at the accident site.

“15. The method of claim 11 further including the step of: generating and displaying on the display interface a replay video of the augmented reality accident scene, wherein the display interface presents a three-dimensional view of the augmented reality accident scene.

“16. The method of claim 11 further including the step of: receiving user input on the display interface from the user to navigate within and interact with the augmented reality accident scene.”

There are additional claims. Please visit full patent to read further.

For more information, see this patent: Dahlman, Jeraldine. Accident re-creation using augmented reality. U.S. Patent Number 11164356, filed May 27, 2020, and published online on November 2, 2021. Patent URL: http://patft.uspto.gov/netacgi/nph-Parser?Sect1=PTO1&Sect2=HITOFF&d=PALL&p=1&u=%2Fnetahtml%2FPTO%2Fsrchnum.htm&r=1&f=G&l=50&s1=11164356.PN.&OS=PN/11164356RS=PN/11164356

(Our reports deliver fact-based news of research and discoveries from around the world.)