Patent Application Titled “Smart Home Sensor Malfunction Detection” Published Online (USPTO 20230306800): State Farm Mutual Automobile Insurance Company

2023 OCT 12 (NewsRx) -- By a News Reporter-Staff News Editor at Insurance Daily News -- According to news reporting originating from Washington, D.C., by NewsRx journalists, a patent application by the inventors Christensen, Scott T. (Salem, OR, US); Farris, Scott (Bloomington, IL, US); Hayward, Gregory (Bloomington, IL, US); Konrardy, Blake (Bloomington, IL, US), filed on May 30, 2023, was made available online on September 28, 2023.

The assignee for this patent application is State Farm Mutual Automobile Insurance Company (Bloomington, Illinois, United States).

Reporters obtained the following quote from the background information supplied by the inventors: “Vehicles are typically operated by a human vehicle operator who controls both steering and motive controls. Operator error, inattention, inexperience, misuse, or distraction leads to many vehicle collisions each year, resulting in injury and damage. Autonomous or semi-autonomous vehicles augment vehicle operators’ information or replace vehicle operators’ control commands to operate the vehicle, in whole or part, with computer systems based upon information from sensors within, or attached to, the vehicle. Such vehicles may be operated with or without passengers, thus requiring different means of control than traditional vehicles. Such vehicles also may include a plurality of advanced sensors, capable of providing significantly more data (both in type and quantity) than is available even from GPS navigation assistance systems installed in traditional vehicles.

“Ensuring safe operation of such autonomous or semi-autonomous vehicles is of the utmost importance because the automated systems of these vehicles may not function properly in all environments. Although autonomous operation may be safer than manual operation under ordinary driving conditions, unusual or irregular environmental conditions may significantly impair the functioning of the autonomous operation features controlling the autonomous vehicle. Under some conditions, autonomous operation may become impractical or excessively dangerous. As an example, fog or heavy rain may greatly reduce the ability of autonomous operation features to safely control the vehicle. Additionally, damage or other impairment of sensors or other components of autonomous systems may significantly increase the risks associated with autonomous operation. Such conditions may change frequently, thereby changing the safety of autonomous vehicle operation. Similar risks associated with impaired sensors may also be present in a smart home environment.”

In addition to obtaining background information on this patent application, NewsRx editors also obtained the inventors’ summary information for this patent application: “The present embodiments may be related to autonomous or semi-autonomous vehicle operation, including driverless operation of fully autonomous vehicles. The embodiments described herein relate particularly to various aspects of autonomous operation feature, component, and software monitoring and/or assessment. When malfunctions or other problems are detected, remedial responses may be determined and implemented. Alternatively, some aspects relate to assessment of features, components, or software, either generally or in particular situations. Specific systems and methods are summarized below. The methods and systems summarized below may include additional, less, or alternate actions, including those discussed elsewhere herein.

“In one aspect, a computer-implemented method for improving the functioning of a computer and/or detecting sensor malfunctions in an autonomous vehicle may be provided. The method may include, via one or more processors, transceivers, and/or sensors: (1) receiving sensor data including a plurality of signals from a plurality of sensors during operation of the autonomous vehicle; (2) selecting, by one or more processors, a first sensor from the plurality of sensors; (3) obtaining, by one or more processors, a first set of signals associated with the first sensor from the plurality of signals; (4) determining, by one or more processors, a first sensor range indicative of a range of signal values associated with proper functioning of the first sensor; (6) determining, by one or more processors, that the first sensor is malfunctioning when at least one signal in the first set of signals associated with the first sensors is outside the first sensor range and/or (7) performing, by one or more processors, an action in response to determining that the first sensor is malfunctioning. The method may include additional, less, or alternate actions, including those discussed elsewhere herein.

“For instance, in some embodiments, the first sensor range may be determined based upon a baseline plurality of signals received from the first sensor during a plurality of previous operation sessions of the autonomous vehicle. In additional embodiments, the first sensor range may be determined by predicting values of signals associated with the first sensor based upon a second set of signals from the plurality of signals, wherein the second set of signals is received from at least one second sensor of the plurality of sensors other than the first sensor during operation of the autonomous vehicle. In some such embodiments, the determination that the first sensor is malfunctioning may be based upon a determination of an inconsistency between the first set of signals and the second set of signals. The first set of signals may be considered outside the first sensor range when the first set of signals includes one or more indications that data from the first sensor is unavailable.

“In further embodiments, the first sensor may be selected in response to additional sensor data indicating a collision involving the autonomous vehicle, such as where the first sensor is disposed within an area of the autonomous vehicle involved in the collision. Alternatively, the first sensor may be determined to be malfunctioning without any indication of a vehicle collision. Determining the first sensor is malfunctioning may include determining a probability of malfunctioning based upon the sensor data, which probability of malfunctioning may indicate a probability of future failure of the first sensor based upon comparison with data from a plurality of other vehicles.

“In some embodiments, the method may further include determining, via the one or more processors, a cause of the first sensor’s malfunction based upon the received sensor data. The received sensor data used in such determination may include a plurality of signals at different times from each of the plurality of sensors, each signal being associated with a timestamp indicating a time associated with the signal. The method may further include determining, via the one or more processors, an apportionment of liability for a cost of repair or replacement of the first sensor based upon the received sensor data. The apportionment of liability may be made between one or more of: a manufacturer of the first sensor, a manufacturer of the autonomous vehicle, an installer of the first sensor, an insurer of the autonomous vehicle, an owner of the autonomous vehicle, or an owner, operator, or insurer of a second vehicle. The action performed by the method may further include automatically scheduling, via the one or more processors, repair or replacement of the first sensor by a third party based upon the determined apportionment of liability. In further embodiments, the method may include receiving additional information associated with a plurality of other vehicles regarding a plurality of sensor malfunctions and/or determining one or more repairs to correct the first sensor’s malfunctioning based upon the received sensor data and additional information.

“In further embodiments, the performed action includes generating, via the one or more processors, an alert regarding the first sensor’s malfunctioning. The alert may be presented to one or more of the following: an operator of the autonomous vehicle or an owner of the autonomous vehicle. The alert may include a recommendation to take one or more of the following actions: repair the first sensor, replace the first sensor, avoid using one or more autonomous operation features of the autonomous vehicle, or avoid using one or more settings associated with the one or more autonomous operation features. The alert may include an indication of an adjustment to a cost or coverage associated with an insurance policy covering operation of the autonomous vehicle based upon the determination that the first sensor is malfunctioning. Such adjustment to the cost or coverage associated with the insurance policy may be based upon a determination of an increase in a risk based upon the first sensor’s malfunctioning. Such adjustment may also be contingent upon usage of one or more autonomous operation features of the autonomous vehicle that utilize data from the first sensor to control the autonomous vehicle.

“In yet further embodiments, the action performed by the method may include identifying, via the one or more processors, one or more autonomous operation features of the autonomous vehicle that utilize data from the first sensor to control the autonomous vehicle; determining, by one or more processors, a risk level for each of the identified autonomous operation features; and/or limiting, via the one or more processors, operation of at least one of the identified one or more autonomous operation features based upon the associated risk level exceeding a safety threshold level. The risk levels may indicate one or more risks associated with operation of the autonomous operation feature when the first sensor is malfunctioning. Limiting operation of the at least one of the identified one or more autonomous operation features may include disabling operation of the at least one of the identified one or more autonomous operation features. Additionally or alternatively the plurality of sensors may include a sensor of a smart infrastructure component and/or a personal electronic device.

“In another aspect, a computer-implemented method for improving the functioning of a computer and/or detecting sensor malfunctions in a smart home may be provided. The method may include, via one or more processors, transceivers, and/or sensors: (1) receiving sensor data including a plurality of signals from a plurality of sensors during operation of the smart home; (2) selecting, by one or more processors, a first sensor from the plurality of sensors; (3) obtaining, by one or more processors, a first set of signals associated with the first sensor from the plurality of signals; (4) determining, by one or more processors, a first sensor range indicative of a range of signal values associated with proper functioning of the first sensor; (6) determining, by one or more processors, that the first sensor is malfunctioning when at least one signal in the first set of signals associated with the first sensors is outside the first sensor range and/or (7) performing, by one or more processors, an action in response to determining that the first sensor is malfunctioning. The method may include additional, less, or alternate actions, including those discussed elsewhere herein.

“For instance, in some embodiments, the first sensor range may be determined based upon a baseline plurality of signals received from the first sensor during a plurality of previous time frames of operation of the smart home. In additional embodiments, the first sensor range may be determined by predicting values of signals associated with the first sensor based upon a second set of signals from the plurality of signals, wherein the second set of signals is received from at least one second sensor of the plurality of sensors other than the first sensor during operation of the smart home. In some such embodiments, the determination that the first sensor is malfunctioning may be based upon a determination of an inconsistency between the first set of signals and the second set of signals. The first set of signals may be considered outside the first sensor range when the first set of signals includes one or more indications that data from the first sensor is unavailable.”

There is additional summary information. Please visit full patent to read further.”

The claims supplied by the inventors are:

“1.-20. (canceled)

“21. A computer-implemented method for detecting sensor malfunctions in a smart home, comprising: receiving, by one or more processors, sensor data including a set of signals associated with a sensor associated with the smart home; determining, by one or more processors, a sensor range indicative of a range of signal values associated with proper functioning of the sensor, wherein the sensor range is determined based upon a baseline plurality of signals received from the sensor during a plurality of previous time frames associated with operation of the smart home; determining, by one or more processors, that the sensor is malfunctioning when at least one signal in the set of signals associated with the sensor is outside the sensor range; and performing, by one or more processors, an action in response to determining that the sensor is malfunctioning; wherein performing the action comprises: generating, via the one or more processors, an alert regarding the sensor’s malfunctioning, wherein the alert includes an indication of an adjustment to a cost or coverage associated with an insurance policy covering operation of the smart home based upon at least one of the determination that the sensor is malfunctioning or an increase in a risk based upon the sensor’s malfunctioning; and transmitting the alert to one or more computing devices.

“22. The computer-implemented method of claim 21, further comprising: selecting, by the one or more processors, the sensor from a plurality of sensors in response to sensor data indicating an event involving the smart home, and the sensor is disposed within an area of the smart home involved in the event.

“23. The computer-implemented method of claim 22, wherein the received sensor data includes a plurality of signals at different times from each of the plurality of sensors, each signal being associated with a timestamp indicating a time associated with the signal.

“24. The computer-implemented method of claim 21, wherein the sensor is determined to be malfunctioning without any indication of an event.

“25. The computer-implemented method of claim 21, further comprising: determining, by one or more processors, a cause of the sensor’s malfunction based upon the received sensor data.

“26. The computer-implemented method of claim 21, further comprising: based upon the received sensor data, determining, via the one or more processors, an apportionment of liability for a cost of repair or replacement of the sensor between one or more of: a manufacturer of the sensor, a manufacturer of a smart equipment, an installer of the sensor, an insurer of the smart home, an owner of the smart home, or an owner, operator, or insurer of a second smart home.

“27. The computer-implemented method of claim 26, wherein performing the action comprises: automatically scheduling, via the one or more processors, repair or replacement of the sensor by a third party based upon the determined apportionment of liability.

“28. The computer-implemented method of claim 21, further comprising: receiving additional information associated with a plurality of other smart homes regarding a plurality of sensor malfunctions; and determining, via the one or more processors, one or more repairs to correct the sensor’s malfunctioning based upon the received sensor data and additional information.

“29. The computer-implemented method of claim 21, wherein determining the sensor is malfunctioning includes determining a probability of malfunctioning based upon the received sensor data.

“30. The computer-implemented method of claim 29, wherein the probability of malfunctioning indicates a probability of future failure of the sensor based upon comparison with data from a plurality of other smart homes.

“31. The computer-implemented method of claim 21, wherein performing the action further comprises: identifying, via the one or more processors, one or more autonomous operation features of the smart home that utilize the received sensor data from the sensor to control the smart home; determining, via the one or more processors, a risk level for each of the identified autonomous operation features, wherein each risk level indicates a risk associated with operation of the autonomous operation feature when the sensor is malfunctioning; and limiting, via the one or more processors, operation of at least one of the identified one or more autonomous operation features based upon a respective risk level exceeding a safety threshold level.

“32. The computer-implemented method of claim 21, wherein the alert further includes a recommendation to take at least one action selected from a group consisting of: repair the sensor, replace the sensor, avoid using one or more autonomous operation features of the smart home, and avoid using one or more settings associated with the one or more autonomous operation features.

“33. The computer-implemented method of claim 21, further comprising: presenting the alert to one or more of the following: an occupant of the smart home or an owner of the smart home.

“34. A computer system configured to detect sensor malfunctions in a smart home, comprising: one or more processors; a non-transitory program memory coupled to the one or more processors and storing executable instructions that, when executed by the one or more processors, cause the computer system to: receive sensor data including a set of signals associated with a sensor associated with the smart home; determine a sensor range indicative of a range of signal values associated with proper functioning of the sensor; determine that the sensor is malfunctioning when at least one signal in the set of signals associated with the sensor is outside the sensor range; and perform an action in response to determining that the sensor is malfunctioning by at least: generating, via the one or more processors, an alert regarding the sensor’s malfunctioning, wherein the alert includes an indication of an adjustment to a cost or coverage associated with an insurance policy covering operation of the smart home based upon at least one of the determination that the sensor is malfunctioning or an increase in a risk based upon the sensor’s malfunctioning; and transmitting the alert to one or more computing devices.

“35. The computer system of claim 34, wherein the sensor range is determined based upon a baseline plurality of signals received from the sensor during a plurality of previous time frames associated with operation of the smart home.

“36. The computer system of claim 34, wherein the sensor is determined to be malfunctioning without any indication of an event.

“37. The computer system of claim 34, wherein the executed executable instructions that, when executed by the one or more processors, further cause the computer system to determine a cause of the sensor’s malfunction based upon the received sensor data.

“38. The computer system of claim 34, wherein each signal in the set of signals is associated with a timestamp indicating a time associated with a respective signal.

“39. A computer-implemented method for detecting sensor malfunctions in a smart home, comprising: receiving sensor data including a set of signals associated with a sensor associated with the smart home; determining, by one or more processors, a sensor range indicative of a range of signal values associated with proper functioning of the sensor; determining, by one or more processors, that the sensor is malfunctioning when at least one signal in the set of signals associated with the sensor is outside the sensor range, wherein the sensor is determined to be malfunctioning without any indication of an event; and performing, by one or more processors, an action in response to determining that the sensor is malfunctioning by at least: generating, by one or more processors, an alert regarding the sensor’s malfunctioning, wherein the alert includes an indication of an adjustment to a cost or coverage associated with an insurance policy covering operation of the smart home based upon at least one of the determination that the sensor is malfunctioning or an increase in a risk based upon the sensor’s malfunctioning; and transmitting the alert to one or more computing devices.

“40. The computer-implemented method of claim 39, wherein performing the action further comprises: identifying, via the one or more processors, one or more autonomous operation features of the smart home that utilize the received sensor data from the sensor to control the smart home; determining, via the one or more processors, a risk level for each of the identified autonomous operation features, wherein each risk level indicates a risk associated with operation of the autonomous operation feature when the sensor is malfunctioning; and limiting, via the one or more processors, operation of at least one of the identified one or more autonomous operation features based upon a respective risk level exceeding a safety threshold level.”

For more information, see this patent application: Christensen, Scott T.; Farris, Scott; Hayward, Gregory; Konrardy, Blake. Smart Home Sensor Malfunction Detection. U.S. Patent Application Number 20230306800, filed May 30, 2023 and posted September 28, 2023. Patent URL (for desktop use only): https://ppubs.uspto.gov/pubwebapp/external.html?q=(20230306800)&db=US-PGPUB&type=ids

(Our reports deliver fact-based news of research and discoveries from around the world.)