Mrthfx

Want to switch to tankless, but can I use my existing wiring?

What is the likely impact on flights of grounding an entire aircraft series?

Is "history" a male-biased word ("his+story")?

What happens with multiple copies of Humility and Glorious Anthem on the battlefield?

It's a yearly task, alright

This equation is outside the page, how to modify it

Playing ONE triplet (not three)

Why do Australian milk farmers need to protest supermarkets' milk price?

Prove that the total distance is minimised (when travelling across the longest path)

What is the blue range indicating on this manifold pressure gauge?

What exactly is the purpose of connection links straped between the rocket and the launch pad

How to discourage/prevent PCs from using door choke-points?

Is it true that real estate prices mainly go up?

Is going from continuous data to categorical always wrong?

How does Dispel Magic work against Stoneskin?

Straight line with arrows and dots

What is the dot in “1.2.4."

Force user to remove USB token

Does the Bracer of Flying Daggers benefit from the Dueling Fighting style?

Why does Deadpool say "You're welcome, Canada," after shooting Ryan Reynolds in the end credits?

Confusion with the nameplate of an induction motor

What to do when during a meeting client people start to fight (even physically) with each others?

Is having access to past exams cheating and, if yes, could it be proven just by a good grade?

What has been your most complicated TikZ drawing?

Deleting missing values from a dataset

How to execute JavaScipt on a webpage and then import the result on OSX?GeoLabels/Tooltips in Geographic Plots from DatasetImport a column of data, make a matrix from it and export it WITHOUT curly bracesShort way to query Dataset by the value of several columnsHow do I import a Dataset that contains lists?Going from Dataset back to underlying AssociationsElegant way to return first non-Missing column in DatasetHow to work with a Dataset?Best way to convert numerical columns of a dataset with missing values into a matrixWhat's the best way to import such dataset?

1

$begingroup$

I wanted to create a dataset of all UFO sightings in April of 2018. The
AssociationThread doesn't want to work, because some of the entries are missing value, what is the best way to fix it?

dataA1 = Import[

"http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

"Data"}];

dataA2 = Flatten[Rest@dataA1, 1];

dataA3 = 

 Map[AssociationThread[First[dataA1], #] &, dataA2]

Dataset[dataA3]

import dataset associations web-access

share|improve this question

edited 29 mins ago

Carl Lange

4,58311038

asked 2 hours ago

Artem AnisimovArtem Anisimov

353

$endgroup$

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  $begingroup$
  To be clear, this isn't about data that is Missing[], but rather Import[XXXX,{"HTML", "Data"}] giving "tables" that have rows with inconsistent lengths.
  $endgroup$
  – Carl Lange
  2 hours ago
  

  
  
  
  

add a comment | 

1

$begingroup$

I wanted to create a dataset of all UFO sightings in April of 2018. The
AssociationThread doesn't want to work, because some of the entries are missing value, what is the best way to fix it?

dataA1 = Import[

"http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

"Data"}];

dataA2 = Flatten[Rest@dataA1, 1];

dataA3 = 

 Map[AssociationThread[First[dataA1], #] &, dataA2]

Dataset[dataA3]

import dataset associations web-access

share|improve this question

edited 29 mins ago

Carl Lange

4,58311038

asked 2 hours ago

Artem AnisimovArtem Anisimov

353

$endgroup$

• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  $begingroup$
  To be clear, this isn't about data that is Missing[], but rather Import[XXXX,{"HTML", "Data"}] giving "tables" that have rows with inconsistent lengths.
  $endgroup$
  – Carl Lange
  2 hours ago
  

  
  
  
  

add a comment | 

$begingroup$

I wanted to create a dataset of all UFO sightings in April of 2018. The
AssociationThread doesn't want to work, because some of the entries are missing value, what is the best way to fix it?

dataA1 = Import[

"http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

"Data"}];

dataA2 = Flatten[Rest@dataA1, 1];

dataA3 = 

 Map[AssociationThread[First[dataA1], #] &, dataA2]

Dataset[dataA3]

import dataset associations web-access

share|improve this question

edited 29 mins ago

Carl Lange

4,58311038

asked 2 hours ago

Artem AnisimovArtem Anisimov

353

$endgroup$

dataA1 = Import[

"http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

"Data"}];

dataA2 = Flatten[Rest@dataA1, 1];

dataA3 = 

 Map[AssociationThread[First[dataA1], #] &, dataA2]

Dataset[dataA3]

share|improve this question

edited 29 mins ago

Carl Lange

4,58311038

asked 2 hours ago

Artem AnisimovArtem Anisimov

353

share|improve this question

edited 29 mins ago

Carl Lange

4,58311038

asked 2 hours ago

Artem AnisimovArtem Anisimov

353

edited 29 mins ago

Carl Lange

4,58311038

edited 29 mins ago

Carl Lange

4,58311038

asked 2 hours ago

Artem AnisimovArtem Anisimov

353

asked 2 hours ago

Artem AnisimovArtem Anisimov

353

1 Answer
1

active

oldest

votes

4

$begingroup$

You can solve this by importing "FullData" rather than "Data".

dataA1 = Import[

  "http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

   "FullData"}]

dataA2 = Flatten[Most@Rest@dataA1[[8]], 1]

dataA3 = Map[AssociationThread[dataA1[[8, 1, 1]], #] &, dataA2];

Dataset[dataA3]

What's awkward about this is that there can be many empty tables that you must sift through (as you can see, I have to get the 8th element). However, it works quite well in this case.

share|improve this answer

answered 2 hours ago

Carl LangeCarl Lange

4,58311038

$endgroup$

• 
  
  
  

  
  

  
  
  
  
  
  

  
  $begingroup$
  Thank you, but I'm not completely sure how "Data" and "FullData" differ. Why do they exist separately?
  $endgroup$
  – Artem Anisimov
  1 hour ago
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  $begingroup$
  @ArtemAnisimov From the documentation for the "HTML" import/export format: "FullData" imports: "full tabular content, including empty HTML table and list elements". "Data" doesn't import empty elements.
  $endgroup$
  – Carl Lange
  45 mins ago
  

  
  
  
  

add a comment | 

Your Answer

StackExchange.ifUsing("editor", function () {
return StackExchange.using("mathjaxEditing", function () {
StackExchange.MarkdownEditor.creationCallbacks.add(function (editor, postfix) {
StackExchange.mathjaxEditing.prepareWmdForMathJax(editor, postfix, [["$", "$"], ["\\(","\\)"]]);
});
});
}, "mathjax-editing");

StackExchange.ready(function() {
var channelOptions = {
tags: "".split(" "),
id: "387"
};
initTagRenderer("".split(" "), "".split(" "), channelOptions);

StackExchange.using("externalEditor", function() {
// Have to fire editor after snippets, if snippets enabled
if (StackExchange.settings.snippets.snippetsEnabled) {
StackExchange.using("snippets", function() {
createEditor();
});
}
else {
createEditor();
}
});

function createEditor() {
StackExchange.prepareEditor({
heartbeatType: 'answer',
autoActivateHeartbeat: false,
convertImagesToLinks: false,
noModals: true,
showLowRepImageUploadWarning: true,
reputationToPostImages: null,
bindNavPrevention: true,
postfix: "",
imageUploader: {
brandingHtml: "Powered by u003ca class="icon-imgur-white" href="https://imgur.com/"u003eu003c/au003e",
contentPolicyHtml: "User contributions licensed under u003ca href="https://creativecommons.org/licenses/by-sa/3.0/"u003ecc by-sa 3.0 with attribution requiredu003c/au003e u003ca href="https://stackoverflow.com/legal/content-policy"u003e(content policy)u003c/au003e",
allowUrls: true
},
onDemand: true,
discardSelector: ".discard-answer"
,immediatelyShowMarkdownHelp:true
});


}
});

draft saved

draft discarded

Sign up or log in

StackExchange.ready(function () {
StackExchange.helpers.onClickDraftSave('#login-link');
});

Sign up using Google

Sign up using Facebook

Sign up using Email and Password

Post as a guest

Name

Email

Required, but never shown

StackExchange.ready(
function () {
StackExchange.openid.initPostLogin('.new-post-login', 'https%3a%2f%2fmathematica.stackexchange.com%2fquestions%2f193199%2fdeleting-missing-values-from-a-dataset%23new-answer', 'question_page');
}
);

Post as a guest

Name

Email

Required, but never shown

4

$begingroup$

You can solve this by importing "FullData" rather than "Data".

dataA1 = Import[

  "http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

   "FullData"}]

dataA2 = Flatten[Most@Rest@dataA1[[8]], 1]

dataA3 = Map[AssociationThread[dataA1[[8, 1, 1]], #] &, dataA2];

Dataset[dataA3]

What's awkward about this is that there can be many empty tables that you must sift through (as you can see, I have to get the 8th element). However, it works quite well in this case.

share|improve this answer

answered 2 hours ago

Carl LangeCarl Lange

4,58311038

$endgroup$

• 
  
  
  

  
  

  
  
  
  
  
  

  
  $begingroup$
  Thank you, but I'm not completely sure how "Data" and "FullData" differ. Why do they exist separately?
  $endgroup$
  – Artem Anisimov
  1 hour ago
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  $begingroup$
  @ArtemAnisimov From the documentation for the "HTML" import/export format: "FullData" imports: "full tabular content, including empty HTML table and list elements". "Data" doesn't import empty elements.
  $endgroup$
  – Carl Lange
  45 mins ago
  

  
  
  
  

add a comment | 

4

$begingroup$

You can solve this by importing "FullData" rather than "Data".

dataA1 = Import[

  "http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

   "FullData"}]

dataA2 = Flatten[Most@Rest@dataA1[[8]], 1]

dataA3 = Map[AssociationThread[dataA1[[8, 1, 1]], #] &, dataA2];

Dataset[dataA3]

What's awkward about this is that there can be many empty tables that you must sift through (as you can see, I have to get the 8th element). However, it works quite well in this case.

share|improve this answer

answered 2 hours ago

Carl LangeCarl Lange

4,58311038

$endgroup$

• 
  
  
  

  
  

  
  
  
  
  
  

  
  $begingroup$
  Thank you, but I'm not completely sure how "Data" and "FullData" differ. Why do they exist separately?
  $endgroup$
  – Artem Anisimov
  1 hour ago
  

  
  
  
  


• 
  
  
  

  
  1
  

  
  
  
  
  
  

  
  $begingroup$
  @ArtemAnisimov From the documentation for the "HTML" import/export format: "FullData" imports: "full tabular content, including empty HTML table and list elements". "Data" doesn't import empty elements.
  $endgroup$
  – Carl Lange
  45 mins ago
  

  
  
  
  

add a comment | 

$begingroup$

You can solve this by importing "FullData" rather than "Data".

dataA1 = Import[

  "http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

   "FullData"}]

dataA2 = Flatten[Most@Rest@dataA1[[8]], 1]

dataA3 = Map[AssociationThread[dataA1[[8, 1, 1]], #] &, dataA2];

Dataset[dataA3]

What's awkward about this is that there can be many empty tables that you must sift through (as you can see, I have to get the 8th element). However, it works quite well in this case.

share|improve this answer

answered 2 hours ago

Carl LangeCarl Lange

4,58311038

$endgroup$

dataA1 = Import[

  "http://www.nuforc.org/webreports/ndxe201804.html", {"HTML", 

   "FullData"}]

dataA2 = Flatten[Most@Rest@dataA1[[8]], 1]

dataA3 = Map[AssociationThread[dataA1[[8, 1, 1]], #] &, dataA2];

Dataset[dataA3]

share|improve this answer

answered 2 hours ago

Carl LangeCarl Lange

4,58311038

answered 2 hours ago

Carl LangeCarl Lange

4,58311038

answered 2 hours ago

Carl LangeCarl Lange

4,58311038